2023-10-14T11:10:19.427 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T11:10:19.428 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261 -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/orig.config.yaml 2023-10-14T11:10:19.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:10:19.567 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} email: null first_in_suite: false job_id: '7425261' kernel: client: sha1: distro flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023oct13 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T11:10:19.568 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T11:10:19.568 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T11:10:19.569 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T11:10:19.571 INFO:teuthology.task.internal:Checking packages... 2023-10-14T11:10:19.594 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T11:10:19.595 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T11:10:19.595 INFO:teuthology.packaging:ref: None 2023-10-14T11:10:19.595 INFO:teuthology.packaging:tag: None 2023-10-14T11:10:19.596 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T11:10:19.596 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:10:19.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T11:10:19.759 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T11:10:19.760 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T11:10:19.767 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T11:10:19.767 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T11:10:19.797 INFO:teuthology.task.internal:Saving configuration 2023-10-14T11:10:19.817 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T11:10:19.823 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T11:10:19.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:04:53.115089', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T11:10:19.875 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:04:53.113527', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T11:10:19.875 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T11:10:19.882 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T11:10:19.882 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T11:10:19.882 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T11:10:19.979 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa870609b80>, signals=[15]) 2023-10-14T11:10:19.980 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T11:10:19.986 INFO:teuthology.task.internal:Opening connections... 2023-10-14T11:10:19.986 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:10:19.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:10:20.057 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:10:20.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:10:20.124 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T11:10:20.130 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2023-10-14T11:10:20.152 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2023-10-14T11:10:20.152 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2023-10-14T11:10:20.212 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:10:20.212 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:10:20.212 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel" 2023-10-14T11:10:20.212 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora" 2023-10-14T11:10:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6" 2023-10-14T11:10:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:10:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:10:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2023-10-14T11:10:20.213 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:10:20.214 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:10:20.214 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:10:20.214 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:10:20.214 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:10:20.214 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:10:20.215 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:10:20.215 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:10:20.215 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:10:20.216 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2023-10-14T11:10:20.241 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-14T11:10:20.261 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-14T11:10:20.262 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-14T11:10:20.321 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-10-14T11:10:20.321 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-10-14T11:10:20.321 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-10-14T11:10:20.321 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-10-14T11:10:20.322 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-10-14T11:10:20.322 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-10-14T11:10:20.322 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-14T11:10:20.322 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-14T11:10:20.322 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-14T11:10:20.323 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-10-14T11:10:20.323 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-14T11:10:20.323 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T11:10:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:10:20.323 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-14T11:10:20.324 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-14T11:10:20.324 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-14T11:10:20.324 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-14T11:10:20.324 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-14T11:10:20.350 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T11:10:20.359 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T11:10:20.379 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T11:10:20.380 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2023-10-14T11:10:20.383 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-10-14T11:10:20.402 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T11:10:20.408 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T11:10:20.408 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2023-10-14T11:10:20.443 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-10-14T11:10:20.471 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T11:10:20.527 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T11:10:20.541 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T11:10:20.541 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-14T11:10:20.542 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-14T11:10:20.542 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T11:10:20.543 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T11:10:20.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:10:20.562 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-10-14T11:10:20.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:10:20.563 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2023-10-14T11:10:20.620 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:20.620 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:20.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-10-14T11:10:20.623 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:20.623 INFO:teuthology.task.kernel:Running kernel on smithi067: 4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:20.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2023-10-14T11:10:21.818 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:21.819 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-14T11:10:22.123 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:22.123 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T11:10:23.295 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-10-14T11:10:24.196 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-10-14T11:10:24.938 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-10-14T11:10:26.111 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-10-14T11:10:27.871 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 536 kB/s | 24 kB 00:00 2023-10-14T11:10:28.548 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T11:10:28.603 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-10-14T11:10:28.605 INFO:teuthology.orchestra.run.smithi067.stdout:Nothing to do. 2023-10-14T11:10:28.605 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-10-14T11:10:28.719 DEBUG:teuthology.orchestra.run.smithi067:> echo no | sudo yum reinstall kernel || true 2023-10-14T11:10:29.069 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:29.069 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-14T11:10:29.348 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 11:10:27 AM UTC. 2023-10-14T11:10:29.395 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T11:10:29.439 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-10-14T11:10:29.487 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum reinstall -y kernel || true 2023-10-14T11:10:29.592 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 456 kB/s | 24 kB 00:00 2023-10-14T11:10:29.838 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:29.839 INFO:teuthology.orchestra.run.smithi067.stdout:Unable to read consumer identity 2023-10-14T11:10:30.103 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:00:03 ago on Sat 14 Oct 2023 11:10:27 AM UTC. 2023-10-14T11:10:30.145 INFO:teuthology.orchestra.run.smithi067.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T11:10:30.277 INFO:teuthology.orchestra.run.smithi067.stderr:Error: No packages marked for reinstall. 2023-10-14T11:10:30.305 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-14T11:10:30.330 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T11:10:30.397 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-14T11:10:30.398 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2023-10-14T11:10:30.398 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-14T11:10:30.412 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:30.413 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:30.413 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T11:10:30.414 DEBUG:teuthology.parallel:result is None 2023-10-14T11:10:30.508 DEBUG:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2023-10-14T11:10:30.840 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:30.840 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T11:10:31.098 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 11:10:29 AM UTC. 2023-10-14T11:10:31.154 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T11:10:31.185 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-14T11:10:31.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2023-10-14T11:10:31.565 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T11:10:31.566 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-10-14T11:10:31.817 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Sat 14 Oct 2023 11:10:29 AM UTC. 2023-10-14T11:10:31.855 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-14T11:10:31.889 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-10-14T11:10:31.935 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-10-14T11:10:32.022 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:32.022 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-14T11:10:32.023 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-14T11:10:32.023 DEBUG:teuthology.parallel:result is None 2023-10-14T11:10:32.023 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T11:10:32.112 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T11:10:32.112 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T11:10:32.116 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T11:10:32.137 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T11:10:32.184 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T11:10:32.243 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T11:10:32.244 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T11:10:32.247 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T11:10:32.273 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T11:10:32.298 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T11:10:32.299 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T11:10:32.315 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T11:10:32.350 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T11:10:32.353 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T11:10:32.364 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T11:10:32.367 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T11:10:32.368 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T11:10:32.384 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T11:10:32.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T11:10:32.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T11:10:32.421 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T11:10:32.459 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T11:10:32.460 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T11:10:32.465 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T11:10:32.487 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T11:10:32.578 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T11:10:32.629 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T11:10:32.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T11:10:32.767 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:10:32.768 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T11:10:32.837 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T11:10:32.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T11:10:32.936 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T11:10:33.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T11:10:33.067 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:10:33.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T11:10:33.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2023-10-14T11:10:33.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-10-14T11:10:33.214 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T11:10:33.259 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T11:10:33.572 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T11:10:33.584 INFO:teuthology.task.internal:Starting timer... 2023-10-14T11:10:33.584 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T11:10:33.642 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T11:10:33.675 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-14T11:10:33.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2023-10-14T11:10:33.795 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2023-10-14T11:10:33.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-10-14T11:10:33.848 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-10-14T11:10:33.850 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T11:10:33.850 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2023-10-14T11:10:33.872 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2023-10-14T11:10:33.873 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-10-14T11:10:33.893 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-10-14T11:10:33.893 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive'} 2023-10-14T11:10:33.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T11:10:33.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:10:33.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T11:10:33.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:10:33.971 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T11:10:33.971 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2023-10-14T11:10:34.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-10-14T11:10:34.038 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T11:10:34.047 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T11:10:34.053 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T11:10:34.205 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T11:10:34.223 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T11:10:34.224 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T11:19:44.723 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com')] 2023-10-14T11:19:44.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-14T11:19:44.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:19:44.795 DEBUG:teuthology.orchestra.run.smithi067:> true 2023-10-14T11:19:44.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2023-10-14T11:19:44.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-14T11:19:44.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T11:19:44.933 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-14T11:19:45.002 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-14T11:19:45.003 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T11:19:45.016 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T11:19:45.017 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T11:19:45.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:19:45.020 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T11:19:45.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:19:45.052 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T11:19:45.067 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T11:19:45.105 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T11:19:45.139 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2023-10-14T11:19:45.151 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T11:19:45.152 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2023-10-14T11:19:45.168 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T11:19:45.182 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T11:19:45.258 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-10-14T11:19:45.262 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T11:19:45.262 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-10-14T11:19:45.263 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.263 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.263 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.263 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.286 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-10-14T11:19:45.330 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-10-14T11:19:45.376 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T11:19:45.422 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T11:19:45.592 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-14T11:19:45.595 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T11:19:45.595 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-14T11:19:45.596 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.596 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.596 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.596 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:19:45.597 INFO:teuthology.run_tasks:Running task install... 2023-10-14T11:19:45.606 DEBUG:teuthology.task.install:project ceph 2023-10-14T11:19:45.607 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T11:19:45.607 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T11:19:45.607 INFO:teuthology.task.install:Using flavor: default 2023-10-14T11:19:45.613 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T11:19:45.614 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T11:19:45.614 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T11:19:45.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:19:45.617 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T11:19:45.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:19:45.763 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T11:19:45.764 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T11:19:45.842 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/ 2023-10-14T11:19:45.842 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T11:19:45.931 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T11:19:45.931 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:19:45.932 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T11:19:45.947 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T11:19:45.947 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:19:45.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T11:19:45.965 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T11:19:45.966 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T11:19:46.007 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T11:19:46.008 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T11:19:46.037 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T11:19:46.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T11:19:46.119 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T11:19:46.168 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T11:19:46.187 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2023-10-14T11:19:46.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2023-10-14T11:19:46.225 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-10-14T11:19:46.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-10-14T11:19:46.582 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-14T11:19:46.587 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T11:19:46.839 INFO:teuthology.orchestra.run.smithi067.stdout:44 files removed 2023-10-14T11:19:46.844 INFO:teuthology.orchestra.run.smithi072.stdout:44 files removed 2023-10-14T11:19:46.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T11:19:46.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T11:19:47.237 INFO:teuthology.orchestra.run.smithi067.stdout:Updating Subscription Management repositories. 2023-10-14T11:19:47.253 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-10-14T11:19:48.015 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 204 kB/s | 81 kB 00:00 2023-10-14T11:19:48.035 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 190 kB/s | 81 kB 00:00 2023-10-14T11:19:48.391 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-14T11:19:48.404 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-14T11:19:48.655 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-10-14T11:19:48.674 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-10-14T11:19:48.806 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-14T11:19:48.834 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-14T11:19:50.202 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-14T11:19:50.837 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:01 2023-10-14T11:19:53.703 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-10-14T11:19:54.660 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 399 kB/s | 24 kB 00:00 2023-10-14T11:19:54.898 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-10-14T11:19:55.728 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 MB/s | 53 MB 00:00 2023-10-14T11:20:03.085 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 53 MB 00:01 2023-10-14T11:20:04.321 INFO:teuthology.orchestra.run.smithi067.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-10-14T11:20:14.159 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T11:20:14.160 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T11:20:14.175 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T11:20:14.176 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T11:20:14.177 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T11:20:14.178 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T11:20:14.180 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T11:20:14.183 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T11:20:14.185 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T11:20:14.317 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-10-14T11:20:14.329 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T11:20:14.330 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-10-14T11:20:14.330 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T11:20:14.330 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-10-14T11:20:14.330 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T11:20:14.331 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T11:20:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T11:20:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T11:20:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T11:20:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T11:20:14.332 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T11:20:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T11:20:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T11:20:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T11:20:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T11:20:14.333 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T11:20:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T11:20:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T11:20:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T11:20:14.334 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T11:20:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T11:20:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T11:20:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T11:20:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T11:20:14.335 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T11:20:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T11:20:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T11:20:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T11:20:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T11:20:14.336 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T11:20:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T11:20:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T11:20:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T11:20:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T11:20:14.337 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T11:20:14.338 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T11:20:14.338 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-10-14T11:20:14.338 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T11:20:14.338 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T11:20:14.338 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T11:20:14.339 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-10-14T11:20:14.339 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T11:20:14.339 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T11:20:14.339 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T11:20:14.339 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T11:20:14.340 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T11:20:14.340 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T11:20:14.340 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T11:20:14.340 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T11:20:14.340 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T11:20:14.341 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T11:20:14.341 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T11:20:14.341 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T11:20:14.341 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T11:20:14.341 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T11:20:14.342 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T11:20:14.342 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T11:20:14.342 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T11:20:14.342 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T11:20:14.342 INFO:teuthology.orchestra.run.smithi072.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T11:20:14.343 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T11:20:14.343 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T11:20:14.343 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T11:20:14.343 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T11:20:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T11:20:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T11:20:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T11:20:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T11:20:14.344 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T11:20:14.345 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T11:20:14.345 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T11:20:14.345 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T11:20:14.345 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T11:20:14.345 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T11:20:14.346 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T11:20:14.346 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T11:20:14.346 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T11:20:14.346 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T11:20:14.347 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T11:20:14.348 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T11:20:14.348 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T11:20:14.348 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T11:20:14.348 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T11:20:14.349 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T11:20:14.349 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T11:20:14.349 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T11:20:14.349 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T11:20:14.349 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T11:20:14.350 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T11:20:14.350 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T11:20:14.350 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T11:20:14.350 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T11:20:14.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T11:20:14.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T11:20:14.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T11:20:14.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T11:20:14.351 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T11:20:14.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T11:20:14.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T11:20:14.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T11:20:14.352 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T11:20:14.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T11:20:14.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T11:20:14.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T11:20:14.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T11:20:14.353 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T11:20:14.354 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T11:20:14.354 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T11:20:14.354 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T11:20:14.354 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T11:20:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T11:20:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T11:20:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T11:20:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T11:20:14.355 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T11:20:14.356 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T11:20:14.357 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T11:20:14.357 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T11:20:14.357 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T11:20:14.357 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T11:20:14.358 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T11:20:14.358 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T11:20:14.358 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling module streams: 2023-10-14T11:20:14.358 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql 10 2023-10-14T11:20:14.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:20:14.359 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-10-14T11:20:14.359 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-10-14T11:20:14.359 INFO:teuthology.orchestra.run.smithi072.stdout:Install 128 Packages 2023-10-14T11:20:14.359 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 3 Packages 2023-10-14T11:20:14.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:20:14.360 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 209 M 2023-10-14T11:20:14.360 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-10-14T11:20:14.504 INFO:teuthology.orchestra.run.smithi072.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-10-14T11:20:14.688 INFO:teuthology.orchestra.run.smithi072.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 4.9 MB/s | 918 kB 00:00 2023-10-14T11:20:14.747 INFO:teuthology.orchestra.run.smithi072.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 2.8 MB/s | 167 kB 00:00 2023-10-14T11:20:15.072 INFO:teuthology.orchestra.run.smithi072.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 7.1 MB/s | 2.3 MB 00:00 2023-10-14T11:20:15.306 INFO:teuthology.orchestra.run.smithi072.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 7.0 MB/s | 1.6 MB 00:00 2023-10-14T11:20:15.541 INFO:teuthology.orchestra.run.smithi072.stdout:(6/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 4.6 MB/s | 5.4 MB 00:01 2023-10-14T11:20:15.975 INFO:teuthology.orchestra.run.smithi072.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 6.9 MB/s | 4.6 MB 00:00 2023-10-14T11:20:16.067 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T11:20:16.068 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-14T11:20:16.084 INFO:teuthology.orchestra.run.smithi067.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-14T11:20:16.085 INFO:teuthology.orchestra.run.smithi067.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-14T11:20:16.086 INFO:teuthology.orchestra.run.smithi067.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-14T11:20:16.087 INFO:teuthology.orchestra.run.smithi067.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-14T11:20:16.090 INFO:teuthology.orchestra.run.smithi067.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-14T11:20:16.093 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-14T11:20:16.094 INFO:teuthology.orchestra.run.smithi067.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-14T11:20:16.238 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2023-10-14T11:20:16.251 INFO:teuthology.orchestra.run.smithi067.stdout:=========================================================================================================================== 2023-10-14T11:20:16.252 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2023-10-14T11:20:16.252 INFO:teuthology.orchestra.run.smithi067.stdout:=========================================================================================================================== 2023-10-14T11:20:16.252 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2023-10-14T11:20:16.252 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-14T11:20:16.253 INFO:teuthology.orchestra.run.smithi067.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-14T11:20:16.253 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.4 k 2023-10-14T11:20:16.253 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 5.4 M 2023-10-14T11:20:16.253 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 918 k 2023-10-14T11:20:16.253 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 167 k 2023-10-14T11:20:16.254 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 1.6 M 2023-10-14T11:20:16.254 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 132 k 2023-10-14T11:20:16.254 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 1.8 M 2023-10-14T11:20:16.254 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 7.4 M 2023-10-14T11:20:16.254 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 47 k 2023-10-14T11:20:16.255 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 14 M 2023-10-14T11:20:16.255 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 49 M 2023-10-14T11:20:16.255 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 261 k 2023-10-14T11:20:16.255 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 192 k 2023-10-14T11:20:16.255 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 261 k 2023-10-14T11:20:16.256 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 18 k 2023-10-14T11:20:16.256 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-14T11:20:16.256 INFO:teuthology.orchestra.run.smithi067.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-14T11:20:16.256 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-14T11:20:16.256 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 31 k 2023-10-14T11:20:16.257 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 839 k 2023-10-14T11:20:16.257 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 139 k 2023-10-14T11:20:16.257 INFO:teuthology.orchestra.run.smithi067.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-14T11:20:16.257 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-14T11:20:16.257 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-14T11:20:16.258 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-14T11:20:16.258 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-14T11:20:16.258 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-14T11:20:16.258 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 197 k 2023-10-14T11:20:16.258 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 371 k 2023-10-14T11:20:16.259 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 365 k 2023-10-14T11:20:16.259 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 107 k 2023-10-14T11:20:16.259 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 94 k 2023-10-14T11:20:16.259 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.6 M 2023-10-14T11:20:16.259 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 179 k 2023-10-14T11:20:16.260 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-14T11:20:16.260 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2023-10-14T11:20:16.260 INFO:teuthology.orchestra.run.smithi067.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-14T11:20:16.260 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T11:20:16.260 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 3.7 M 2023-10-14T11:20:16.261 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2023-10-14T11:20:16.261 INFO:teuthology.orchestra.run.smithi067.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-14T11:20:16.261 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 23 M 2023-10-14T11:20:16.261 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 23 k 2023-10-14T11:20:16.261 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 2.3 M 2023-10-14T11:20:16.262 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 242 k 2023-10-14T11:20:16.262 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 4.6 M 2023-10-14T11:20:16.262 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 18 M 2023-10-14T11:20:16.262 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el8 ceph-noarch 15 k 2023-10-14T11:20:16.262 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 24 k 2023-10-14T11:20:16.263 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-14T11:20:16.263 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-14T11:20:16.263 INFO:teuthology.orchestra.run.smithi067.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-14T11:20:16.263 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-14T11:20:16.263 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-14T11:20:16.264 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 184 k 2023-10-14T11:20:16.264 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-14T11:20:16.264 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-14T11:20:16.264 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-14T11:20:16.264 INFO:teuthology.orchestra.run.smithi067.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-14T11:20:16.265 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-14T11:20:16.265 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-14T11:20:16.265 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 518 k 2023-10-14T11:20:16.265 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-14T11:20:16.265 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 6.9 M 2023-10-14T11:20:16.266 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-14T11:20:16.266 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-14T11:20:16.266 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-14T11:20:16.266 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-14T11:20:16.266 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-14T11:20:16.267 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-14T11:20:16.267 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-14T11:20:16.267 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-14T11:20:16.267 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-14T11:20:16.267 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-14T11:20:16.268 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-14T11:20:16.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-14T11:20:16.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-14T11:20:16.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-14T11:20:16.268 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-14T11:20:16.269 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-14T11:20:16.269 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 45 k 2023-10-14T11:20:16.269 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el8 ceph 126 k 2023-10-14T11:20:16.269 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-14T11:20:16.269 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-14T11:20:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-14T11:20:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-14T11:20:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-14T11:20:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-14T11:20:16.270 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-14T11:20:16.271 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-14T11:20:16.271 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-14T11:20:16.271 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-14T11:20:16.271 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-14T11:20:16.271 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T11:20:16.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-14T11:20:16.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-14T11:20:16.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-14T11:20:16.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-14T11:20:16.272 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-14T11:20:16.273 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-14T11:20:16.274 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-14T11:20:16.274 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-14T11:20:16.274 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-14T11:20:16.274 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-14T11:20:16.275 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-14T11:20:16.276 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-14T11:20:16.276 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-14T11:20:16.276 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-14T11:20:16.276 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-14T11:20:16.276 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-14T11:20:16.277 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-14T11:20:16.277 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-14T11:20:16.277 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-14T11:20:16.277 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-14T11:20:16.277 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-14T11:20:16.278 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-14T11:20:16.278 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-14T11:20:16.278 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-14T11:20:16.278 INFO:teuthology.orchestra.run.smithi067.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-14T11:20:16.278 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-14T11:20:16.279 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-14T11:20:16.279 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling module streams: 2023-10-14T11:20:16.279 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql 10 2023-10-14T11:20:16.279 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:20:16.279 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2023-10-14T11:20:16.280 INFO:teuthology.orchestra.run.smithi067.stdout:=========================================================================================================================== 2023-10-14T11:20:16.280 INFO:teuthology.orchestra.run.smithi067.stdout:Install 128 Packages 2023-10-14T11:20:16.280 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 3 Packages 2023-10-14T11:20:16.280 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:20:16.281 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 209 M 2023-10-14T11:20:16.281 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2023-10-14T11:20:16.546 INFO:teuthology.orchestra.run.smithi067.stdout:(1/131): ceph-18.0.0-6730.g4ba8a190.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-10-14T11:20:16.559 INFO:teuthology.orchestra.run.smithi072.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 10 MB/s | 23 MB 00:02 2023-10-14T11:20:16.710 INFO:teuthology.orchestra.run.smithi072.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 162 kB/s | 24 kB 00:00 2023-10-14T11:20:17.480 INFO:teuthology.orchestra.run.smithi067.stdout:(2/131): ceph-fuse-18.0.0-6730.g4ba8a190.el8.x8 984 kB/s | 918 kB 00:00 2023-10-14T11:20:17.589 INFO:teuthology.orchestra.run.smithi067.stdout:(3/131): ceph-immutable-object-cache-18.0.0-673 1.5 MB/s | 167 kB 00:00 2023-10-14T11:20:17.810 INFO:teuthology.orchestra.run.smithi072.stdout:(10/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 7.9 MB/s | 18 MB 00:02 2023-10-14T11:20:17.903 INFO:teuthology.orchestra.run.smithi072.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.8 MB/s | 261 kB 00:00 2023-10-14T11:20:18.003 INFO:teuthology.orchestra.run.smithi072.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 309 kB/s | 31 kB 00:00 2023-10-14T11:20:18.271 INFO:teuthology.orchestra.run.smithi072.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 3.1 MB/s | 839 kB 00:00 2023-10-14T11:20:18.530 INFO:teuthology.orchestra.run.smithi067.stdout:(4/131): ceph-mds-18.0.0-6730.g4ba8a190.el8.x86 2.5 MB/s | 2.3 MB 00:00 2023-10-14T11:20:18.604 INFO:teuthology.orchestra.run.smithi072.stdout:(14/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 5.3 MB/s | 14 MB 00:02 2023-10-14T11:20:18.630 INFO:teuthology.orchestra.run.smithi072.stdout:(15/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 512 kB/s | 184 kB 00:00 2023-10-14T11:20:18.655 INFO:teuthology.orchestra.run.smithi072.stdout:(16/131): librados-devel-18.0.0-6730.g4ba8a190. 2.7 MB/s | 139 kB 00:00 2023-10-14T11:20:18.923 INFO:teuthology.orchestra.run.smithi072.stdout:(17/131): libradosstriper1-18.0.0-6730.g4ba8a19 1.7 MB/s | 518 kB 00:00 2023-10-14T11:20:19.015 INFO:teuthology.orchestra.run.smithi072.stdout:(18/131): python3-ceph-argparse-18.0.0-6730.g4b 488 kB/s | 45 kB 00:00 2023-10-14T11:20:19.109 INFO:teuthology.orchestra.run.smithi072.stdout:(19/131): python3-ceph-common-18.0.0-6730.g4ba8 1.3 MB/s | 126 kB 00:00 2023-10-14T11:20:19.139 INFO:teuthology.orchestra.run.smithi067.stdout:(5/131): ceph-mgr-18.0.0-6730.g4ba8a190.el8.x86 2.7 MB/s | 1.6 MB 00:00 2023-10-14T11:20:19.201 INFO:teuthology.orchestra.run.smithi072.stdout:(20/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.1 MB/s | 197 kB 00:00 2023-10-14T11:20:19.376 INFO:teuthology.orchestra.run.smithi072.stdout:(21/131): python3-rados-18.0.0-6730.g4ba8a190.e 2.1 MB/s | 371 kB 00:00 2023-10-14T11:20:19.489 INFO:teuthology.orchestra.run.smithi067.stdout:(6/131): ceph-base-18.0.0-6730.g4ba8a190.el8.x8 1.8 MB/s | 5.4 MB 00:03 2023-10-14T11:20:19.552 INFO:teuthology.orchestra.run.smithi072.stdout:(22/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.0 MB/s | 365 kB 00:00 2023-10-14T11:20:19.653 INFO:teuthology.orchestra.run.smithi072.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.0 MB/s | 107 kB 00:00 2023-10-14T11:20:19.753 INFO:teuthology.orchestra.run.smithi072.stdout:(24/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 933 kB/s | 94 kB 00:00 2023-10-14T11:20:20.179 INFO:teuthology.orchestra.run.smithi072.stdout:(25/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 4.5 MB/s | 6.9 MB 00:01 2023-10-14T11:20:20.263 INFO:teuthology.orchestra.run.smithi072.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 2.1 MB/s | 179 kB 00:00 2023-10-14T11:20:20.339 INFO:teuthology.orchestra.run.smithi072.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 307 kB/s | 23 kB 00:00 2023-10-14T11:20:20.422 INFO:teuthology.orchestra.run.smithi072.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.6 MB/s | 132 kB 00:00 2023-10-14T11:20:20.889 INFO:teuthology.orchestra.run.smithi072.stdout:(29/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 3.2 MB/s | 3.6 MB 00:01 2023-10-14T11:20:20.923 INFO:teuthology.orchestra.run.smithi067.stdout:(7/131): ceph-mon-18.0.0-6730.g4ba8a190.el8.x86 2.6 MB/s | 4.6 MB 00:01 2023-10-14T11:20:21.281 INFO:teuthology.orchestra.run.smithi067.stdout:(8/131): ceph-common-18.0.0-6730.g4ba8a190.el8. 4.6 MB/s | 23 MB 00:04 2023-10-14T11:20:21.332 INFO:teuthology.orchestra.run.smithi067.stdout:(9/131): ceph-selinux-18.0.0-6730.g4ba8a190.el8 490 kB/s | 24 kB 00:00 2023-10-14T11:20:21.665 INFO:teuthology.orchestra.run.smithi072.stdout:(30/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 9.9 MB/s | 49 MB 00:04 2023-10-14T11:20:21.715 INFO:teuthology.orchestra.run.smithi072.stdout:(31/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 1.4 MB/s | 1.8 MB 00:01 2023-10-14T11:20:21.749 INFO:teuthology.orchestra.run.smithi072.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6730.g4b 2.8 MB/s | 242 kB 00:00 2023-10-14T11:20:21.792 INFO:teuthology.orchestra.run.smithi072.stdout:(33/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 626 kB/s | 47 kB 00:00 2023-10-14T11:20:21.834 INFO:teuthology.orchestra.run.smithi072.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6730.g4 179 kB/s | 15 kB 00:00 2023-10-14T11:20:21.961 INFO:teuthology.orchestra.run.smithi072.stdout:(35/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.5 MB/s | 192 kB 00:00 2023-10-14T11:20:21.987 INFO:teuthology.orchestra.run.smithi072.stdout:(36/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 1.3 MB/s | 261 kB 00:00 2023-10-14T11:20:22.012 INFO:teuthology.orchestra.run.smithi072.stdout:(37/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 358 kB/s | 18 kB 00:00 2023-10-14T11:20:22.188 INFO:teuthology.orchestra.run.smithi072.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 336 kB/s | 59 kB 00:00 2023-10-14T11:20:22.264 INFO:teuthology.orchestra.run.smithi072.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-10-14T11:20:22.289 INFO:teuthology.orchestra.run.smithi072.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 744 kB/s | 75 kB 00:00 2023-10-14T11:20:22.423 INFO:teuthology.orchestra.run.smithi072.stdout:(41/131): ceph-mgr-diskprediction-local-18.0.0- 4.8 MB/s | 7.4 MB 00:01 2023-10-14T11:20:22.448 INFO:teuthology.orchestra.run.smithi072.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 274 kB/s | 44 kB 00:00 2023-10-14T11:20:22.482 INFO:teuthology.orchestra.run.smithi072.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-14T11:20:22.516 INFO:teuthology.orchestra.run.smithi072.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 489 kB/s | 33 kB 00:00 2023-10-14T11:20:22.541 INFO:teuthology.orchestra.run.smithi072.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 276 kB/s | 16 kB 00:00 2023-10-14T11:20:22.609 INFO:teuthology.orchestra.run.smithi072.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-10-14T11:20:22.673 INFO:teuthology.orchestra.run.smithi072.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.9 MB/s | 384 kB 00:00 2023-10-14T11:20:22.703 INFO:teuthology.orchestra.run.smithi072.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 865 kB/s | 81 kB 00:00 2023-10-14T11:20:22.729 INFO:teuthology.orchestra.run.smithi072.stdout:(49/131): python3-beautifulsoup4-4.6.3-2.el8.1. 607 kB/s | 185 kB 00:00 2023-10-14T11:20:22.754 INFO:teuthology.orchestra.run.smithi072.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 138 kB/s | 11 kB 00:00 2023-10-14T11:20:22.780 INFO:teuthology.orchestra.run.smithi072.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 230 kB/s | 18 kB 00:00 2023-10-14T11:20:22.822 INFO:teuthology.orchestra.run.smithi072.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 723 kB/s | 49 kB 00:00 2023-10-14T11:20:22.847 INFO:teuthology.orchestra.run.smithi072.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 870 kB/s | 59 kB 00:00 2023-10-14T11:20:22.889 INFO:teuthology.orchestra.run.smithi072.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2023-10-14T11:20:22.915 INFO:teuthology.orchestra.run.smithi072.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 649 kB/s | 60 kB 00:00 2023-10-14T11:20:22.941 INFO:teuthology.orchestra.run.smithi072.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-14T11:20:22.966 INFO:teuthology.orchestra.run.smithi072.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 204 kB/s | 16 kB 00:00 2023-10-14T11:20:22.992 INFO:teuthology.orchestra.run.smithi072.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 440 kB/s | 34 kB 00:00 2023-10-14T11:20:23.024 INFO:teuthology.orchestra.run.smithi067.stdout:(10/131): ceph-radosgw-18.0.0-6730.g4ba8a190.el 6.6 MB/s | 14 MB 00:02 2023-10-14T11:20:23.025 INFO:teuthology.orchestra.run.smithi072.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-14T11:20:23.051 INFO:teuthology.orchestra.run.smithi072.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 759 kB/s | 64 kB 00:00 2023-10-14T11:20:23.077 INFO:teuthology.orchestra.run.smithi072.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 221 kB/s | 19 kB 00:00 2023-10-14T11:20:23.090 INFO:teuthology.orchestra.run.smithi067.stdout:(11/131): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.8 MB/s | 261 kB 00:00 2023-10-14T11:20:23.102 INFO:teuthology.orchestra.run.smithi072.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 314 kB/s | 24 kB 00:00 2023-10-14T11:20:23.128 INFO:teuthology.orchestra.run.smithi072.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 384 kB/s | 29 kB 00:00 2023-10-14T11:20:23.155 INFO:teuthology.orchestra.run.smithi072.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 354 kB/s | 27 kB 00:00 2023-10-14T11:20:23.167 INFO:teuthology.orchestra.run.smithi067.stdout:(12/131): libcephfs-devel-18.0.0-6730.g4ba8a190 408 kB/s | 31 kB 00:00 2023-10-14T11:20:23.180 INFO:teuthology.orchestra.run.smithi072.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.2 MB/s | 255 kB 00:00 2023-10-14T11:20:23.206 INFO:teuthology.orchestra.run.smithi072.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-10-14T11:20:23.232 INFO:teuthology.orchestra.run.smithi072.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 803 kB/s | 61 kB 00:00 2023-10-14T11:20:23.257 INFO:teuthology.orchestra.run.smithi072.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-14T11:20:23.282 INFO:teuthology.orchestra.run.smithi072.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 301 kB/s | 23 kB 00:00 2023-10-14T11:20:23.308 INFO:teuthology.orchestra.run.smithi067.stdout:(13/131): libcephfs2-18.0.0-6730.g4ba8a190.el8. 5.8 MB/s | 839 kB 00:00 2023-10-14T11:20:23.308 INFO:teuthology.orchestra.run.smithi072.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-10-14T11:20:23.366 INFO:teuthology.orchestra.run.smithi067.stdout:(14/131): libcephsqlite-18.0.0-6730.g4ba8a190.e 3.1 MB/s | 184 kB 00:00 2023-10-14T11:20:23.383 INFO:teuthology.orchestra.run.smithi072.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.5 MB/s | 110 kB 00:00 2023-10-14T11:20:23.425 INFO:teuthology.orchestra.run.smithi067.stdout:(15/131): librados-devel-18.0.0-6730.g4ba8a190. 2.3 MB/s | 139 kB 00:00 2023-10-14T11:20:23.442 INFO:teuthology.orchestra.run.smithi072.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 8.2 MB/s | 1.7 MB 00:00 2023-10-14T11:20:23.468 INFO:teuthology.orchestra.run.smithi072.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 645 kB/s | 54 kB 00:00 2023-10-14T11:20:23.525 INFO:teuthology.orchestra.run.smithi067.stdout:(16/131): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 518 kB 00:00 2023-10-14T11:20:23.535 INFO:teuthology.orchestra.run.smithi072.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.7 MB/s | 259 kB 00:00 2023-10-14T11:20:23.569 INFO:teuthology.orchestra.run.smithi072.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.3 MB/s | 323 kB 00:00 2023-10-14T11:20:23.594 INFO:teuthology.orchestra.run.smithi072.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 658 kB/s | 39 kB 00:00 2023-10-14T11:20:23.637 INFO:teuthology.orchestra.run.smithi072.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-14T11:20:23.670 INFO:teuthology.orchestra.run.smithi072.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.9 MB/s | 538 kB 00:00 2023-10-14T11:20:23.705 INFO:teuthology.orchestra.run.smithi072.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-14T11:20:23.740 INFO:teuthology.orchestra.run.smithi072.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-10-14T11:20:23.782 INFO:teuthology.orchestra.run.smithi072.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 9.0 MB/s | 713 kB 00:00 2023-10-14T11:20:23.841 INFO:teuthology.orchestra.run.smithi072.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 455 kB/s | 27 kB 00:00 2023-10-14T11:20:23.891 INFO:teuthology.orchestra.run.smithi072.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-10-14T11:20:24.001 INFO:teuthology.orchestra.run.smithi072.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-10-14T11:20:24.034 INFO:teuthology.orchestra.run.smithi072.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 309 kB/s | 44 kB 00:00 2023-10-14T11:20:24.301 INFO:teuthology.orchestra.run.smithi072.stdout:(86/131): python3-scipy-1.0.0-21.module+el8.5.0 13 MB/s | 14 MB 00:01 2023-10-14T11:20:24.334 INFO:teuthology.orchestra.run.smithi067.stdout:(17/131): ceph-osd-18.0.0-6730.g4ba8a190.el8.x8 3.7 MB/s | 18 MB 00:04 2023-10-14T11:20:24.335 INFO:teuthology.orchestra.run.smithi072.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2023-10-14T11:20:24.369 INFO:teuthology.orchestra.run.smithi072.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-10-14T11:20:24.394 INFO:teuthology.orchestra.run.smithi072.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-14T11:20:24.420 INFO:teuthology.orchestra.run.smithi072.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.4 MB/s | 126 kB 00:00 2023-10-14T11:20:24.445 INFO:teuthology.orchestra.run.smithi072.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 395 kB/s | 20 kB 00:00 2023-10-14T11:20:24.471 INFO:teuthology.orchestra.run.smithi072.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-14T11:20:24.476 INFO:teuthology.orchestra.run.smithi067.stdout:(18/131): librgw2-18.0.0-6730.g4ba8a190.el8.x86 7.3 MB/s | 6.9 MB 00:00 2023-10-14T11:20:24.501 INFO:teuthology.orchestra.run.smithi067.stdout:(19/131): python3-ceph-argparse-18.0.0-6730.g4b 268 kB/s | 45 kB 00:00 2023-10-14T11:20:24.513 INFO:teuthology.orchestra.run.smithi072.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-10-14T11:20:24.526 INFO:teuthology.orchestra.run.smithi067.stdout:(20/131): python3-ceph-common-18.0.0-6730.g4ba8 2.5 MB/s | 126 kB 00:00 2023-10-14T11:20:24.568 INFO:teuthology.orchestra.run.smithi067.stdout:(21/131): python3-cephfs-18.0.0-6730.g4ba8a190. 2.9 MB/s | 197 kB 00:00 2023-10-14T11:20:24.597 INFO:teuthology.orchestra.run.smithi072.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.3 MB/s | 3.7 MB 00:00 2023-10-14T11:20:24.619 INFO:teuthology.orchestra.run.smithi067.stdout:(22/131): python3-rados-18.0.0-6730.g4ba8a190.e 3.9 MB/s | 371 kB 00:00 2023-10-14T11:20:24.631 INFO:teuthology.orchestra.run.smithi072.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2023-10-14T11:20:24.677 INFO:teuthology.orchestra.run.smithi067.stdout:(23/131): python3-rgw-18.0.0-6730.g4ba8a190.el8 1.8 MB/s | 107 kB 00:00 2023-10-14T11:20:24.691 INFO:teuthology.orchestra.run.smithi072.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.3 MB/s | 202 kB 00:00 2023-10-14T11:20:24.702 INFO:teuthology.orchestra.run.smithi067.stdout:(24/131): python3-rbd-18.0.0-6730.g4ba8a190.el8 2.7 MB/s | 365 kB 00:00 2023-10-14T11:20:24.728 INFO:teuthology.orchestra.run.smithi067.stdout:(25/131): rbd-fuse-18.0.0-6730.g4ba8a190.el8.x8 1.8 MB/s | 94 kB 00:00 2023-10-14T11:20:24.758 INFO:teuthology.orchestra.run.smithi072.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-10-14T11:20:24.778 INFO:teuthology.orchestra.run.smithi067.stdout:(26/131): rbd-nbd-18.0.0-6730.g4ba8a190.el8.x86 3.5 MB/s | 179 kB 00:00 2023-10-14T11:20:24.820 INFO:teuthology.orchestra.run.smithi067.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6730.g 556 kB/s | 23 kB 00:00 2023-10-14T11:20:24.859 INFO:teuthology.orchestra.run.smithi072.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-10-14T11:20:24.879 INFO:teuthology.orchestra.run.smithi067.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.2 MB/s | 132 kB 00:00 2023-10-14T11:20:25.005 INFO:teuthology.orchestra.run.smithi072.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-10-14T11:20:25.093 INFO:teuthology.orchestra.run.smithi072.stdout:(100/131): postgresql-contrib-10.21-2.module+el 3.4 MB/s | 808 kB 00:00 2023-10-14T11:20:25.129 INFO:teuthology.orchestra.run.smithi067.stdout:(29/131): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 7.1 MB/s | 1.8 MB 00:00 2023-10-14T11:20:25.202 INFO:teuthology.orchestra.run.smithi072.stdout:(101/131): postgresql-server-10.21-2.module+el8 11 MB/s | 5.1 MB 00:00 2023-10-14T11:20:25.228 INFO:teuthology.orchestra.run.smithi072.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 349 kB/s | 47 kB 00:00 2023-10-14T11:20:25.287 INFO:teuthology.orchestra.run.smithi072.stdout:(103/131): postgresql-10.21-2.module+el8.6.0+15 5.4 MB/s | 1.5 MB 00:00 2023-10-14T11:20:25.312 INFO:teuthology.orchestra.run.smithi072.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 543 kB/s | 43 kB 00:00 2023-10-14T11:20:25.338 INFO:teuthology.orchestra.run.smithi072.stdout:(105/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.4 MB/s | 200 kB 00:00 2023-10-14T11:20:25.372 INFO:teuthology.orchestra.run.smithi072.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 812 kB/s | 48 kB 00:00 2023-10-14T11:20:25.397 INFO:teuthology.orchestra.run.smithi072.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-10-14T11:20:25.431 INFO:teuthology.orchestra.run.smithi072.stdout:(108/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-14T11:20:25.457 INFO:teuthology.orchestra.run.smithi072.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 505 kB/s | 43 kB 00:00 2023-10-14T11:20:25.471 INFO:teuthology.orchestra.run.smithi067.stdout:(30/131): rbd-mirror-18.0.0-6730.g4ba8a190.el8. 4.7 MB/s | 3.6 MB 00:00 2023-10-14T11:20:25.482 INFO:teuthology.orchestra.run.smithi072.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.3 MB/s | 109 kB 00:00 2023-10-14T11:20:25.509 INFO:teuthology.orchestra.run.smithi072.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.9 MB/s | 229 kB 00:00 2023-10-14T11:20:25.551 INFO:teuthology.orchestra.run.smithi072.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.8 MB/s | 560 kB 00:00 2023-10-14T11:20:25.577 INFO:teuthology.orchestra.run.smithi072.stdout:(113/131): libaio-devel-0.3.112-1.el8.x86_64.rp 198 kB/s | 19 kB 00:00 2023-10-14T11:20:25.602 INFO:teuthology.orchestra.run.smithi072.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2023-10-14T11:20:25.628 INFO:teuthology.orchestra.run.smithi072.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 354 kB/s | 18 kB 00:00 2023-10-14T11:20:25.670 INFO:teuthology.orchestra.run.smithi072.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-10-14T11:20:25.704 INFO:teuthology.orchestra.run.smithi072.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.8 MB/s | 605 kB 00:00 2023-10-14T11:20:25.729 INFO:teuthology.orchestra.run.smithi072.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-10-14T11:20:25.763 INFO:teuthology.orchestra.run.smithi072.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-14T11:20:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-10-14T11:20:25.814 INFO:teuthology.orchestra.run.smithi072.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-14T11:20:25.840 INFO:teuthology.orchestra.run.smithi072.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-14T11:20:25.866 INFO:teuthology.orchestra.run.smithi072.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-14T11:20:25.900 INFO:teuthology.orchestra.run.smithi072.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 653 kB/s | 39 kB 00:00 2023-10-14T11:20:25.963 INFO:teuthology.orchestra.run.smithi067.stdout:(31/131): ceph-test-18.0.0-6730.g4ba8a190.el8.x 11 MB/s | 49 MB 00:04 2023-10-14T11:20:25.966 INFO:teuthology.orchestra.run.smithi072.stdout:(125/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 7.9 MB/s | 2.3 MB 00:00 2023-10-14T11:20:25.988 INFO:teuthology.orchestra.run.smithi067.stdout:(32/131): ceph-mgr-modules-core-18.0.0-6730.g4b 469 kB/s | 242 kB 00:00 2023-10-14T11:20:26.002 INFO:teuthology.orchestra.run.smithi072.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.6 MB/s | 644 kB 00:00 2023-10-14T11:20:26.014 INFO:teuthology.orchestra.run.smithi067.stdout:(33/131): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 949 kB/s | 47 kB 00:00 2023-10-14T11:20:26.028 INFO:teuthology.orchestra.run.smithi072.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-10-14T11:20:26.047 INFO:teuthology.orchestra.run.smithi067.stdout:(34/131): ceph-prometheus-alerts-18.0.0-6730.g4 257 kB/s | 15 kB 00:00 2023-10-14T11:20:26.061 INFO:teuthology.orchestra.run.smithi072.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.4 MB/s | 138 kB 00:00 2023-10-14T11:20:26.098 INFO:teuthology.orchestra.run.smithi067.stdout:(35/131): ceph-volume-18.0.0-6730.g4ba8a190.el8 3.1 MB/s | 261 kB 00:00 2023-10-14T11:20:26.148 INFO:teuthology.orchestra.run.smithi067.stdout:(36/131): cephfs-top-18.0.0-6730.g4ba8a190.el8. 362 kB/s | 18 kB 00:00 2023-10-14T11:20:26.154 INFO:teuthology.orchestra.run.smithi072.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 8.5 MB/s | 798 kB 00:00 2023-10-14T11:20:26.173 INFO:teuthology.orchestra.run.smithi067.stdout:(37/131): cephadm-18.0.0-6730.g4ba8a190.el8.noa 1.5 MB/s | 192 kB 00:00 2023-10-14T11:20:26.282 INFO:teuthology.orchestra.run.smithi067.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.4 MB/s | 7.4 MB 00:01 2023-10-14T11:20:26.454 INFO:teuthology.orchestra.run.smithi072.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 8.3 MB/s | 3.7 MB 00:00 2023-10-14T11:20:26.507 INFO:teuthology.orchestra.run.smithi067.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 176 kB/s | 59 kB 00:00 2023-10-14T11:20:26.599 INFO:teuthology.orchestra.run.smithi067.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 244 kB/s | 75 kB 00:00 2023-10-14T11:20:26.641 INFO:teuthology.orchestra.run.smithi067.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 622 kB/s | 306 kB 00:00 2023-10-14T11:20:26.663 INFO:teuthology.orchestra.run.smithi072.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 5.8 MB/s | 3.7 MB 00:00 2023-10-14T11:20:26.666 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-10-14T11:20:26.666 INFO:teuthology.orchestra.run.smithi072.stdout:Total 17 MB/s | 209 MB 00:12 2023-10-14T11:20:26.699 INFO:teuthology.orchestra.run.smithi067.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-10-14T11:20:26.741 INFO:teuthology.orchestra.run.smithi067.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-14T11:20:26.775 INFO:teuthology.orchestra.run.smithi067.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-10-14T11:20:26.792 INFO:teuthology.orchestra.run.smithi067.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 359 kB/s | 33 kB 00:00 2023-10-14T11:20:26.825 INFO:teuthology.orchestra.run.smithi067.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 195 kB/s | 16 kB 00:00 2023-10-14T11:20:26.861 INFO:teuthology.orchestra.run.smithi067.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-10-14T11:20:26.987 INFO:teuthology.orchestra.run.smithi067.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 504 kB/s | 81 kB 00:00 2023-10-14T11:20:27.101 INFO:teuthology.orchestra.run.smithi067.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 46 kB/s | 11 kB 00:00 2023-10-14T11:20:27.127 INFO:teuthology.orchestra.run.smithi067.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 126 kB/s | 18 kB 00:00 2023-10-14T11:20:27.160 INFO:teuthology.orchestra.run.smithi067.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-10-14T11:20:27.219 INFO:teuthology.orchestra.run.smithi067.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 531 kB/s | 49 kB 00:00 2023-10-14T11:20:27.244 INFO:teuthology.orchestra.run.smithi067.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 702 kB/s | 59 kB 00:00 2023-10-14T11:20:27.278 INFO:teuthology.orchestra.run.smithi067.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2023-10-14T11:20:27.303 INFO:teuthology.orchestra.run.smithi067.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 720 kB/s | 60 kB 00:00 2023-10-14T11:20:27.345 INFO:teuthology.orchestra.run.smithi067.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-10-14T11:20:27.370 INFO:teuthology.orchestra.run.smithi067.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-10-14T11:20:27.396 INFO:teuthology.orchestra.run.smithi067.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 364 kB/s | 34 kB 00:00 2023-10-14T11:20:27.421 INFO:teuthology.orchestra.run.smithi067.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2023-10-14T11:20:27.455 INFO:teuthology.orchestra.run.smithi067.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 764 kB/s | 64 kB 00:00 2023-10-14T11:20:27.480 INFO:teuthology.orchestra.run.smithi067.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2023-10-14T11:20:27.499 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-10-14T11:20:27.505 INFO:teuthology.orchestra.run.smithi067.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 284 kB/s | 24 kB 00:00 2023-10-14T11:20:27.547 INFO:teuthology.orchestra.run.smithi067.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-10-14T11:20:27.572 INFO:teuthology.orchestra.run.smithi067.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-10-14T11:20:27.597 INFO:teuthology.orchestra.run.smithi067.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2023-10-14T11:20:27.619 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-10-14T11:20:27.619 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-10-14T11:20:27.648 INFO:teuthology.orchestra.run.smithi067.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-10-14T11:20:27.673 INFO:teuthology.orchestra.run.smithi067.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 609 kB/s | 61 kB 00:00 2023-10-14T11:20:27.698 INFO:teuthology.orchestra.run.smithi067.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 848 kB/s | 85 kB 00:00 2023-10-14T11:20:27.724 INFO:teuthology.orchestra.run.smithi067.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-10-14T11:20:27.749 INFO:teuthology.orchestra.run.smithi067.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-14T11:20:27.828 INFO:teuthology.orchestra.run.smithi067.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 453 kB/s | 47 kB 00:00 2023-10-14T11:20:27.858 INFO:teuthology.orchestra.run.smithi067.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-10-14T11:20:27.883 INFO:teuthology.orchestra.run.smithi067.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 775 kB/s | 43 kB 00:00 2023-10-14T11:20:27.917 INFO:teuthology.orchestra.run.smithi067.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-10-14T11:20:27.950 INFO:teuthology.orchestra.run.smithi067.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 6.3 MB/s | 1.7 MB 00:00 2023-10-14T11:20:27.976 INFO:teuthology.orchestra.run.smithi067.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 523 kB/s | 48 kB 00:00 2023-10-14T11:20:28.009 INFO:teuthology.orchestra.run.smithi067.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 944 kB/s | 87 kB 00:00 2023-10-14T11:20:28.034 INFO:teuthology.orchestra.run.smithi067.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 510 kB/s | 43 kB 00:00 2023-10-14T11:20:28.060 INFO:teuthology.orchestra.run.smithi067.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-10-14T11:20:28.076 INFO:teuthology.orchestra.run.smithi067.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-10-14T11:20:28.094 INFO:teuthology.orchestra.run.smithi067.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 556 kB/s | 19 kB 00:00 2023-10-14T11:20:28.127 INFO:teuthology.orchestra.run.smithi067.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-14T11:20:28.161 INFO:teuthology.orchestra.run.smithi067.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-10-14T11:20:28.178 INFO:teuthology.orchestra.run.smithi067.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-10-14T11:20:28.211 INFO:teuthology.orchestra.run.smithi067.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-10-14T11:20:28.245 INFO:teuthology.orchestra.run.smithi067.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-10-14T11:20:28.270 INFO:teuthology.orchestra.run.smithi067.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-14T11:20:28.296 INFO:teuthology.orchestra.run.smithi067.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-14T11:20:28.321 INFO:teuthology.orchestra.run.smithi067.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-14T11:20:28.346 INFO:teuthology.orchestra.run.smithi067.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-14T11:20:28.380 INFO:teuthology.orchestra.run.smithi067.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.6 MB/s | 98 kB 00:00 2023-10-14T11:20:28.405 INFO:teuthology.orchestra.run.smithi067.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 980 kB/s | 58 kB 00:00 2023-10-14T11:20:28.430 INFO:teuthology.orchestra.run.smithi067.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-10-14T11:20:28.498 INFO:teuthology.orchestra.run.smithi067.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 6.8 MB/s | 644 kB 00:00 2023-10-14T11:20:28.523 INFO:teuthology.orchestra.run.smithi067.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.8 MB/s | 171 kB 00:00 2023-10-14T11:20:28.548 INFO:teuthology.orchestra.run.smithi067.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-14T11:20:28.607 INFO:teuthology.orchestra.run.smithi067.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2023-10-14T11:20:28.632 INFO:teuthology.orchestra.run.smithi067.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-14T11:20:28.657 INFO:teuthology.orchestra.run.smithi067.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-14T11:20:28.691 INFO:teuthology.orchestra.run.smithi067.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-10-14T11:20:28.724 INFO:teuthology.orchestra.run.smithi067.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-14T11:20:28.736 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-10-14T11:20:28.741 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-10-14T11:20:28.749 INFO:teuthology.orchestra.run.smithi067.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 665 kB/s | 39 kB 00:00 2023-10-14T11:20:28.792 INFO:teuthology.orchestra.run.smithi067.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-10-14T11:20:28.825 INFO:teuthology.orchestra.run.smithi067.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-10-14T11:20:28.850 INFO:teuthology.orchestra.run.smithi067.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-14T11:20:28.876 INFO:teuthology.orchestra.run.smithi067.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-14T11:20:28.926 INFO:teuthology.orchestra.run.smithi067.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-14T11:20:28.968 INFO:teuthology.orchestra.run.smithi067.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-10-14T11:20:29.010 INFO:teuthology.orchestra.run.smithi067.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-14T11:20:29.052 INFO:teuthology.orchestra.run.smithi067.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-10-14T11:20:29.160 INFO:teuthology.orchestra.run.smithi067.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2023-10-14T11:20:29.227 INFO:teuthology.orchestra.run.smithi067.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 6.7 MB/s | 457 kB 00:00 2023-10-14T11:20:29.314 INFO:teuthology.orchestra.run.smithi067.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-10-14T11:20:29.336 INFO:teuthology.orchestra.run.smithi067.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-10-14T11:20:29.370 INFO:teuthology.orchestra.run.smithi067.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-14T11:20:29.395 INFO:teuthology.orchestra.run.smithi067.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.1 MB/s | 126 kB 00:00 2023-10-14T11:20:29.412 INFO:teuthology.orchestra.run.smithi067.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 477 kB/s | 20 kB 00:00 2023-10-14T11:20:29.437 INFO:teuthology.orchestra.run.smithi067.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-10-14T11:20:29.488 INFO:teuthology.orchestra.run.smithi067.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-10-14T11:20:29.646 INFO:teuthology.orchestra.run.smithi067.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-10-14T11:20:29.672 INFO:teuthology.orchestra.run.smithi067.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-10-14T11:20:29.714 INFO:teuthology.orchestra.run.smithi067.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-14T11:20:29.781 INFO:teuthology.orchestra.run.smithi067.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-10-14T11:20:29.864 INFO:teuthology.orchestra.run.smithi067.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-10-14T11:20:29.940 INFO:teuthology.orchestra.run.smithi067.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-10-14T11:20:29.982 INFO:teuthology.orchestra.run.smithi067.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-14T11:20:30.040 INFO:teuthology.orchestra.run.smithi067.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-10-14T11:20:30.124 INFO:teuthology.orchestra.run.smithi067.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-10-14T11:20:30.174 INFO:teuthology.orchestra.run.smithi067.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-14T11:20:30.466 INFO:teuthology.orchestra.run.smithi067.stdout:(130/131): librados2-18.0.0-6730.g4ba8a190.el8. 7.7 MB/s | 3.7 MB 00:00 2023-10-14T11:20:30.891 INFO:teuthology.orchestra.run.smithi067.stdout:(131/131): librbd1-18.0.0-6730.g4ba8a190.el8.x8 4.4 MB/s | 3.7 MB 00:00 2023-10-14T11:20:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2023-10-14T11:20:30.894 INFO:teuthology.orchestra.run.smithi067.stdout:Total 14 MB/s | 209 MB 00:14 2023-10-14T11:20:31.763 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2023-10-14T11:20:31.895 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2023-10-14T11:20:31.895 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2023-10-14T11:20:33.090 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2023-10-14T11:20:33.094 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2023-10-14T11:20:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-10-14T11:20:33.821 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T11:20:34.020 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T11:20:34.239 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-14T11:20:34.441 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T11:20:34.576 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-14T11:20:34.800 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T11:20:35.200 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-14T11:20:35.508 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:20:35.922 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:20:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:20:36.264 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:20:36.458 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T11:20:36.564 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T11:20:36.817 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T11:20:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T11:20:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T11:20:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T11:20:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T11:20:38.049 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2023-10-14T11:20:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T11:20:38.331 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-14T11:20:38.405 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T11:20:38.516 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-14T11:20:38.616 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T11:20:38.666 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-14T11:20:38.688 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T11:20:38.841 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-14T11:20:38.874 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T11:20:39.018 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-14T11:20:39.066 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-14T11:20:39.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T11:20:39.513 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-14T11:20:39.716 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-14T11:20:39.802 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-14T11:20:40.041 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T11:20:40.154 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 5/134 2023-10-14T11:20:40.341 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:20:40.476 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:20:40.642 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-14T11:20:40.699 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:20:40.781 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:20:40.873 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T11:20:40.954 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T11:20:41.142 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-14T11:20:41.407 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-14T11:20:41.601 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-14T11:20:41.603 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-14T11:20:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-14T11:20:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-14T11:20:42.144 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-14T11:20:42.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-14T11:20:42.416 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T11:20:42.427 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-14T11:20:42.511 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 14/134 2023-10-14T11:20:42.621 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-14T11:20:42.716 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T11:20:42.839 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-14T11:20:42.851 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 15/134 2023-10-14T11:20:43.045 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-14T11:20:43.068 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T11:20:43.254 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T11:20:43.264 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-14T11:20:43.755 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-14T11:20:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T11:20:43.915 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-14T11:20:44.065 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-14T11:20:44.198 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-14T11:20:44.712 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T11:20:44.845 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-14T11:20:45.007 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-14T11:20:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-14T11:20:45.325 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-14T11:20:45.584 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-14T11:20:45.648 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-14T11:20:45.773 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T11:20:45.857 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-14T11:20:46.616 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-14T11:20:46.856 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-14T11:20:47.051 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-14T11:20:47.279 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-14T11:20:47.422 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 26/134 2023-10-14T11:20:47.535 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 27/134 2023-10-14T11:20:47.577 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-14T11:20:47.793 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 28/134 2023-10-14T11:20:47.924 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-14T11:20:47.965 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-14T11:20:48.143 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T11:20:48.384 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T11:20:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T11:20:48.793 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T11:20:49.290 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-14T11:20:49.691 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-14T11:20:49.847 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-14T11:20:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-14T11:20:50.044 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-14T11:20:50.306 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-14T11:20:50.521 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-14T11:20:50.924 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-14T11:20:50.927 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-14T11:20:51.200 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-14T11:20:51.262 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-14T11:20:51.423 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-14T11:20:51.529 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-14T11:20:51.659 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-14T11:20:51.779 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-14T11:20:51.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-14T11:20:51.979 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-14T11:20:52.152 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-14T11:20:52.262 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-14T11:20:52.354 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 36/134 2023-10-14T11:20:52.505 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 37/134 2023-10-14T11:20:52.538 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-14T11:20:52.647 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-14T11:20:52.766 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-14T11:20:52.800 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-14T11:20:53.022 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-14T11:20:53.054 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-14T11:20:53.080 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-14T11:20:53.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-14T11:20:53.317 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-14T11:20:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-14T11:20:53.561 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-14T11:20:53.723 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-14T11:20:53.789 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-14T11:20:53.808 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-14T11:20:54.024 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-14T11:20:54.060 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-14T11:20:54.400 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-14T11:20:54.554 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-14T11:20:54.584 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-14T11:20:54.746 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-14T11:20:54.751 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-14T11:20:54.920 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-14T11:20:54.928 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-14T11:20:55.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T11:20:55.125 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-14T11:20:55.224 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-14T11:20:55.324 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-14T11:20:55.461 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-14T11:20:55.690 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-14T11:20:55.723 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-14T11:20:55.880 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T11:20:55.956 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-14T11:20:55.967 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-14T11:20:56.185 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-14T11:20:56.189 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-14T11:20:56.416 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-14T11:20:56.422 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-14T11:20:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T11:20:56.629 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-14T11:20:56.808 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T11:20:56.975 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-14T11:20:57.108 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T11:20:57.189 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-14T11:20:57.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T11:20:57.394 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-14T11:20:57.559 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T11:20:57.604 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-14T11:20:57.732 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T11:20:57.772 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-14T11:20:57.947 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T11:20:57.952 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-14T11:20:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T11:20:58.267 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-14T11:20:58.358 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T11:20:58.510 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-14T11:20:58.541 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T11:20:58.744 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T11:20:58.772 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-14T11:20:58.977 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T11:20:58.982 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-14T11:20:59.130 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-14T11:20:59.193 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T11:20:59.352 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-14T11:20:59.411 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T11:20:59.625 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-14T11:20:59.695 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T11:20:59.830 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-14T11:21:00.002 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-14T11:21:00.013 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T11:21:00.143 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-14T11:21:00.204 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T11:21:00.328 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-14T11:21:00.451 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T11:21:00.529 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-14T11:21:00.728 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-14T11:21:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-14T11:21:01.020 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-14T11:21:01.283 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-14T11:21:01.485 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-14T11:21:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T11:21:01.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-14T11:21:01.866 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T11:21:01.975 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-14T11:21:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T11:21:02.197 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-14T11:21:02.356 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-14T11:21:02.455 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T11:21:02.605 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-14T11:21:02.741 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T11:21:02.976 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T11:21:03.732 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-14T11:21:03.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T11:21:03.978 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-14T11:21:03.987 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T11:21:04.054 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T11:21:04.224 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-14T11:21:04.263 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T11:21:04.559 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-14T11:21:04.809 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-14T11:21:04.998 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-14T11:21:05.864 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-14T11:21:06.029 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T11:21:06.087 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 92/134 2023-10-14T11:21:06.238 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 93/134 2023-10-14T11:21:08.219 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:08.454 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:09.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T11:21:09.461 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T11:21:09.629 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T11:21:10.179 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:10.546 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:11.177 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 94/134 2023-10-14T11:21:11.458 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T11:21:11.531 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 95/134 2023-10-14T11:21:11.696 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T11:21:30.599 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T11:21:30.599 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-10-14T11:21:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-10-14T11:21:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-14T11:21:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-10-14T11:21:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-10-14T11:21:30.600 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-10-14T11:21:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-10-14T11:21:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-10-14T11:21:30.601 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-10-14T11:21:30.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:21:30.984 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T11:21:31.112 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 96/134 2023-10-14T11:21:31.112 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2023-10-14T11:21:31.113 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2023-10-14T11:21:31.113 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-10-14T11:21:31.113 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /run 2023-10-14T11:21:31.113 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2023-10-14T11:21:31.113 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2023-10-14T11:21:31.114 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2023-10-14T11:21:31.114 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2023-10-14T11:21:31.114 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /dev 2023-10-14T11:21:31.114 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:21:31.468 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T11:21:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T11:21:32.783 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T11:21:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T11:21:33.165 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 97/134 2023-10-14T11:21:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T11:21:33.372 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T11:21:33.605 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 98/134 2023-10-14T11:21:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T11:21:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T11:21:33.834 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T11:21:33.851 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T11:21:34.254 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 99/134 2023-10-14T11:21:34.443 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T11:21:34.460 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 100/134 2023-10-14T11:21:35.579 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T11:21:35.793 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T11:21:35.940 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T11:21:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T11:21:36.282 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T11:21:36.350 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T11:21:36.466 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 101/134 2023-10-14T11:21:36.571 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T11:21:36.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 102/134 2023-10-14T11:21:36.802 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 103/134 2023-10-14T11:21:36.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T11:21:36.976 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T11:21:37.204 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 104/134 2023-10-14T11:21:37.471 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T11:21:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T11:21:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T11:21:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T11:21:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 105/134 2023-10-14T11:21:38.565 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T11:21:38.642 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T11:21:38.739 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 106/134 2023-10-14T11:21:38.757 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T11:21:38.792 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T11:21:38.975 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T11:21:38.986 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T11:21:39.156 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 107/134 2023-10-14T11:21:39.321 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T11:21:39.358 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 108/134 2023-10-14T11:21:39.517 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T11:21:39.528 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 109/134 2023-10-14T11:21:40.327 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T11:21:40.622 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T11:21:40.658 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T11:21:40.817 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T11:21:40.860 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T11:21:40.934 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 110/134 2023-10-14T11:21:41.034 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T11:21:41.175 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T11:21:41.210 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 111/134 2023-10-14T11:21:41.359 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T11:21:41.402 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T11:21:41.403 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 112/134 2023-10-14T11:21:41.551 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T11:21:41.583 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T11:21:41.939 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 113/134 2023-10-14T11:21:42.100 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T11:21:46.299 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T11:21:46.602 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T11:21:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T11:21:47.002 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-14T11:21:47.057 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 114/134 2023-10-14T11:21:47.899 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-14T11:21:47.967 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 115/134 2023-10-14T11:21:48.269 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-14T11:21:48.317 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-14T11:21:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 119/134 2023-10-14T11:21:48.483 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 117/134 2023-10-14T11:21:48.703 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T11:21:48.722 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-14T11:21:48.874 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-14T11:21:48.886 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T11:21:49.050 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T11:21:49.078 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-14T11:21:49.287 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-14T11:21:49.471 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 121/134 2023-10-14T11:21:49.609 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T11:21:51.246 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:51.515 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:51.533 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:51.733 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T11:21:51.968 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:52.065 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T11:21:52.191 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:52.209 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-14T11:21:52.367 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 124/134 2023-10-14T11:21:52.387 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T11:21:52.650 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 125/134 2023-10-14T11:21:52.708 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T11:21:52.840 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T11:21:52.849 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T11:21:52.924 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 126/134 2023-10-14T11:21:53.056 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-14T11:21:53.274 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-14T11:21:53.289 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T11:21:53.375 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-14T11:21:53.457 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-14T11:21:53.552 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-14T11:21:53.598 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T11:21:53.610 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-14T11:21:53.611 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:53.757 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-14T11:21:53.770 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-14T11:21:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:53.851 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T11:21:53.941 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-14T11:21:53.949 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-14T11:21:54.085 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-14T11:21:54.085 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:54.113 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T11:21:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:54.286 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T11:21:54.339 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:54.548 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-14T11:21:54.732 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:54.864 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T11:21:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T11:21:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T11:21:54.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T11:21:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T11:21:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:21:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:21:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T11:21:54.866 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T11:21:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T11:21:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T11:21:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T11:21:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T11:21:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T11:21:54.868 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T11:21:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T11:21:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T11:21:54.869 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T11:21:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T11:21:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T11:21:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T11:21:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T11:21:54.870 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T11:21:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T11:21:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T11:21:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T11:21:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T11:21:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T11:21:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T11:21:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T11:21:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T11:21:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T11:21:54.872 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T11:21:54.873 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T11:21:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T11:21:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T11:21:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T11:21:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T11:21:54.874 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T11:21:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T11:21:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T11:21:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T11:21:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T11:21:54.875 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T11:21:54.876 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T11:21:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T11:21:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T11:21:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T11:21:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T11:21:54.877 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T11:21:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T11:21:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T11:21:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T11:21:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T11:21:54.878 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T11:21:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T11:21:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-14T11:21:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-14T11:21:54.879 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-14T11:21:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-14T11:21:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-14T11:21:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-14T11:21:54.880 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-14T11:21:54.881 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-14T11:21:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-14T11:21:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-14T11:21:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-14T11:21:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-14T11:21:54.882 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-14T11:21:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-14T11:21:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-14T11:21:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-14T11:21:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-14T11:21:54.883 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-14T11:21:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-14T11:21:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-14T11:21:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-14T11:21:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-14T11:21:54.884 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-14T11:21:54.885 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-14T11:21:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-14T11:21:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-14T11:21:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-14T11:21:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-14T11:21:54.886 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-14T11:21:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-14T11:21:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-14T11:21:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-14T11:21:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-14T11:21:54.887 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-14T11:21:54.888 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-14T11:21:54.889 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-14T11:21:54.889 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-14T11:21:54.889 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-14T11:21:54.889 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-14T11:21:54.890 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-14T11:21:54.890 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-14T11:21:54.890 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-14T11:21:54.890 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T11:21:54.891 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T11:21:54.891 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T11:21:54.891 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:54.891 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T11:21:55.280 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:55.280 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 1/134 2023-10-14T11:21:55.280 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2/134 2023-10-14T11:21:55.281 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 3/134 2023-10-14T11:21:55.281 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 4/134 2023-10-14T11:21:55.281 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/134 2023-10-14T11:21:55.281 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 6/134 2023-10-14T11:21:55.281 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 7/134 2023-10-14T11:21:55.282 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 8/134 2023-10-14T11:21:55.282 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 9/134 2023-10-14T11:21:55.282 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 10/134 2023-10-14T11:21:55.282 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 11/134 2023-10-14T11:21:55.282 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 12/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 13/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_ 14/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 15/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 16/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_6 17/134 2023-10-14T11:21:55.283 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86 18/134 2023-10-14T11:21:55.284 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 19/134 2023-10-14T11:21:55.284 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/134 2023-10-14T11:21:55.284 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8. 21/134 2023-10-14T11:21:55.284 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_6 22/134 2023-10-14T11:21:55.284 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 23/134 2023-10-14T11:21:55.285 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 24/134 2023-10-14T11:21:55.285 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 25/134 2023-10-14T11:21:55.285 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 26/134 2023-10-14T11:21:55.285 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 27/134 2023-10-14T11:21:55.285 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 28/134 2023-10-14T11:21:55.286 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/134 2023-10-14T11:21:55.286 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noa 30/134 2023-10-14T11:21:55.286 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.n 31/134 2023-10-14T11:21:55.286 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/134 2023-10-14T11:21:55.286 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 34/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 36/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 37/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 38/134 2023-10-14T11:21:55.287 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-14T11:21:55.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-14T11:21:55.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-14T11:21:55.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-14T11:21:55.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-14T11:21:55.288 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-14T11:21:55.289 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-14T11:21:55.290 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-14T11:21:55.290 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-14T11:21:55.290 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-14T11:21:55.290 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-14T11:21:55.290 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-14T11:21:55.291 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-14T11:21:55.291 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-14T11:21:55.291 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-14T11:21:55.291 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-14T11:21:55.291 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-14T11:21:55.292 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-14T11:21:55.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-14T11:21:55.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-14T11:21:55.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-14T11:21:55.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-14T11:21:55.293 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-14T11:21:55.294 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-14T11:21:55.294 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-14T11:21:55.294 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-14T11:21:55.294 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-14T11:21:55.294 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-14T11:21:55.295 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-14T11:21:55.296 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-14T11:21:55.296 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-14T11:21:55.296 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-14T11:21:55.296 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-14T11:21:55.296 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-14T11:21:55.297 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-14T11:21:55.298 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-14T11:21:55.298 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-14T11:21:55.298 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-14T11:21:55.298 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-14T11:21:55.298 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-14T11:21:55.299 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-14T11:21:55.299 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-14T11:21:55.299 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-14T11:21:55.299 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-14T11:21:55.299 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-14T11:21:55.300 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-14T11:21:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-14T11:21:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-14T11:21:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-14T11:21:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-14T11:21:55.302 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-14T11:21:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-14T11:21:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-14T11:21:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-14T11:21:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-14T11:21:55.303 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 129/134 2023-10-14T11:21:55.304 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-14T11:21:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 131/134 2023-10-14T11:21:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-14T11:21:55.305 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-14T11:21:57.682 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:57.683 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:55 ago on Sat 14 Oct 2023 11:20:02 AM UTC. 2023-10-14T11:21:57.989 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-14T11:21:57.990 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:54 ago on Sat 14 Oct 2023 11:20:03 AM UTC. 2023-10-14T11:22:00.471 INFO:teuthology.orchestra.run.smithi072.stdout:Installed products updated. 2023-10-14T11:22:00.691 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:00.691 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-10-14T11:22:00.691 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T11:22:00.691 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.692 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.692 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-10-14T11:22:00.692 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T11:22:00.692 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T11:22:00.692 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.693 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.694 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.694 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.694 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.694 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.694 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.695 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.695 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.695 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.695 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.695 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.696 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.696 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.696 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.696 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.696 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.697 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.697 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:00.697 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T11:22:00.697 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T11:22:00.697 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-3.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T11:22:00.698 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.699 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.699 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.699 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T11:22:00.699 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T11:22:00.700 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T11:22:00.700 INFO:teuthology.orchestra.run.smithi072.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T11:22:00.700 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T11:22:00.700 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T11:22:00.700 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.701 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.701 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T11:22:00.701 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.701 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T11:22:00.701 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T11:22:00.702 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T11:22:00.702 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T11:22:00.702 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T11:22:00.702 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T11:22:00.702 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T11:22:00.703 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T11:22:00.704 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T11:22:00.704 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:00.704 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:00.704 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:00.704 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T11:22:00.705 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T11:22:00.705 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T11:22:00.705 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T11:22:00.705 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T11:22:00.705 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T11:22:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T11:22:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T11:22:00.707 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T11:22:00.707 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T11:22:00.707 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T11:22:00.707 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T11:22:00.707 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T11:22:00.708 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T11:22:00.708 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T11:22:00.708 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T11:22:00.708 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T11:22:00.708 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T11:22:00.709 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T11:22:00.709 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T11:22:00.709 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T11:22:00.709 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T11:22:00.709 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T11:22:00.710 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T11:22:00.710 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T11:22:00.710 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T11:22:00.710 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T11:22:00.710 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T11:22:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T11:22:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T11:22:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T11:22:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T11:22:00.711 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T11:22:00.712 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T11:22:00.712 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.712 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.712 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T11:22:00.713 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T11:22:00.714 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T11:22:00.714 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T11:22:00.714 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T11:22:00.714 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T11:22:00.715 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.716 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.716 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:00.716 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T11:22:00.716 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T11:22:00.716 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T11:22:00.717 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T11:22:00.717 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T11:22:00.717 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T11:22:00.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:00.718 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-10-14T11:22:00.966 DEBUG:teuthology.parallel:result is None 2023-10-14T11:22:01.566 INFO:teuthology.orchestra.run.smithi067.stdout:Installed products updated. 2023-10-14T11:22:01.807 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:01.807 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2023-10-14T11:22:01.807 INFO:teuthology.orchestra.run.smithi067.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-14T11:22:01.807 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.808 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.808 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2023-10-14T11:22:01.808 INFO:teuthology.orchestra.run.smithi067.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-14T11:22:01.808 INFO:teuthology.orchestra.run.smithi067.stdout: automake-1.16.1-7.el8.noarch 2023-10-14T11:22:01.808 INFO:teuthology.orchestra.run.smithi067.stdout: bison-3.0.4-10.el8.x86_64 2023-10-14T11:22:01.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.809 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.810 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.811 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.811 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.811 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.811 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.811 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.812 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el8.noarch 2023-10-14T11:22:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-14T11:22:01.813 INFO:teuthology.orchestra.run.smithi067.stdout: flex-2.6.1-9.el8.x86_64 2023-10-14T11:22:01.814 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-14T11:22:01.814 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-14T11:22:01.814 INFO:teuthology.orchestra.run.smithi067.stdout: jq-1.6-3.el8.x86_64 2023-10-14T11:22:01.814 INFO:teuthology.orchestra.run.smithi067.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-14T11:22:01.814 INFO:teuthology.orchestra.run.smithi067.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-14T11:22:01.815 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-14T11:22:01.816 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-14T11:22:01.816 INFO:teuthology.orchestra.run.smithi067.stdout: libpq-13.5-1.el8.x86_64 2023-10-14T11:22:01.816 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-14T11:22:01.816 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-14T11:22:01.816 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.817 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.817 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-14T11:22:01.817 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.817 INFO:teuthology.orchestra.run.smithi067.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-14T11:22:01.817 INFO:teuthology.orchestra.run.smithi067.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-14T11:22:01.818 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-14T11:22:01.818 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-14T11:22:01.818 INFO:teuthology.orchestra.run.smithi067.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-14T11:22:01.818 INFO:teuthology.orchestra.run.smithi067.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-14T11:22:01.818 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-14T11:22:01.819 INFO:teuthology.orchestra.run.smithi067.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-14T11:22:01.819 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-14T11:22:01.819 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-14T11:22:01.819 INFO:teuthology.orchestra.run.smithi067.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-14T11:22:01.819 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-14T11:22:01.820 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-14T11:22:01.821 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-14T11:22:01.821 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-14T11:22:01.821 INFO:teuthology.orchestra.run.smithi067.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-14T11:22:01.821 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-14T11:22:01.821 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.822 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.822 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.822 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-14T11:22:01.822 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-14T11:22:01.822 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-14T11:22:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-14T11:22:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-14T11:22:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-14T11:22:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-14T11:22:01.823 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-14T11:22:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-14T11:22:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-14T11:22:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-14T11:22:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-14T11:22:01.824 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-14T11:22:01.825 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-14T11:22:01.826 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-14T11:22:01.826 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-14T11:22:01.826 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-14T11:22:01.826 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-2.6-1.el8.noarch 2023-10-14T11:22:01.826 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-14T11:22:01.827 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-14T11:22:01.827 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-14T11:22:01.827 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-14T11:22:01.827 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-14T11:22:01.827 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-14T11:22:01.828 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.828 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.828 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-14T11:22:01.828 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-14T11:22:01.828 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.829 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-14T11:22:01.829 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-14T11:22:01.829 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-14T11:22:01.829 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-14T11:22:01.829 INFO:teuthology.orchestra.run.smithi067.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-14T11:22:01.830 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-14T11:22:01.830 INFO:teuthology.orchestra.run.smithi067.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-14T11:22:01.830 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-14T11:22:01.830 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-14T11:22:01.830 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.831 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el8.x86_64 2023-10-14T11:22:01.832 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-14T11:22:01.832 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-14T11:22:01.832 INFO:teuthology.orchestra.run.smithi067.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-14T11:22:01.832 INFO:teuthology.orchestra.run.smithi067.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-14T11:22:01.832 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-14T11:22:01.833 INFO:teuthology.orchestra.run.smithi067.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-14T11:22:01.833 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:01.833 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2023-10-14T11:22:02.013 DEBUG:teuthology.parallel:result is None 2023-10-14T11:22:02.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:22:02.227 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T11:22:02.252 INFO:teuthology.orchestra.run.smithi067.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T11:22:02.253 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T11:22:02.253 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T11:22:02.254 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T11:22:02.390 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T11:22:02.418 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-6730.g4ba8a190.el8 2023-10-14T11:22:02.419 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el8 2023-10-14T11:22:02.419 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T11:22:02.420 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T11:22:02.420 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:02.421 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T11:22:02.464 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:02.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T11:22:02.510 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T11:22:02.510 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:02.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T11:22:02.539 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T11:22:02.606 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:02.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T11:22:02.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T11:22:02.703 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T11:22:02.703 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:02.704 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T11:22:02.731 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T11:22:02.798 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:02.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T11:22:02.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T11:22:02.893 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T11:22:02.894 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:02.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T11:22:02.921 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T11:22:02.988 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:02.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T11:22:03.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T11:22:03.081 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T11:22:03.144 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T11:22:03.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2023-10-14T11:22:03.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-10-14T11:22:03.174 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T11:22:03.175 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T11:22:03.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T11:22:03.241 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T11:22:03.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T11:22:03.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T11:22:03.314 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T11:22:03.314 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T11:22:03.314 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T11:22:03.315 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:03.315 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T11:22:03.363 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:03.511 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:03.539 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:03.539 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T11:22:03.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:03.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:03.720 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T11:22:03.721 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T11:22:03.721 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7425261', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T11:22:03.722 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T11:22:03.725 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T11:22:03.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T11:22:03.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T11:22:03.838 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:03.838 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T11:22:03.862 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T11:22:03.863 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2023-10-14T11:22:03.920 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T11:22:03.920 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:03.920 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 386798 Links: 1 2023-10-14T11:22:03.921 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:03.921 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:03.921 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-14 11:21:54.958525602 +0000 2023-10-14T11:22:03.921 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-14 11:19:16.820339380 +0000 2023-10-14T11:22:03.921 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-14 11:19:16.820339380 +0000 2023-10-14T11:22:03.922 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-14T11:22:03.922 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T11:22:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-14T11:22:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-14T11:22:03.985 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000247303 s, 2.1 MB/s 2023-10-14T11:22:03.986 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T11:22:04.044 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2023-10-14T11:22:04.102 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T11:22:04.102 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:04.102 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 392713 Links: 1 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-14 11:21:54.958525602 +0000 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-14 11:19:17.324328406 +0000 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-14 11:19:17.324328406 +0000 2023-10-14T11:22:04.103 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-14T11:22:04.104 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T11:22:04.167 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-14T11:22:04.168 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-14T11:22:04.168 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000320641 s, 1.6 MB/s 2023-10-14T11:22:04.169 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T11:22:04.226 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2023-10-14T11:22:04.284 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T11:22:04.284 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:04.284 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 392104 Links: 1 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-14 11:21:54.958525602 +0000 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-14 11:19:17.841317148 +0000 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-14 11:19:17.841317148 +0000 2023-10-14T11:22:04.285 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-14T11:22:04.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T11:22:04.350 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-14T11:22:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-14T11:22:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000231593 s, 2.2 MB/s 2023-10-14T11:22:04.352 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T11:22:04.409 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2023-10-14T11:22:04.467 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T11:22:04.468 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:04.468 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 392810 Links: 1 2023-10-14T11:22:04.468 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:04.468 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:04.469 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2023-10-14 11:21:54.958525602 +0000 2023-10-14T11:22:04.469 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2023-10-14 11:19:18.354305977 +0000 2023-10-14T11:22:04.469 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2023-10-14 11:19:18.354305977 +0000 2023-10-14T11:22:04.469 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2023-10-14T11:22:04.470 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T11:22:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2023-10-14T11:22:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2023-10-14T11:22:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000184265 s, 2.8 MB/s 2023-10-14T11:22:04.536 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T11:22:04.593 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:04.594 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:04.594 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T11:22:04.614 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T11:22:04.614 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-10-14T11:22:04.675 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T11:22:04.675 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:04.675 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 393416 Links: 1 2023-10-14T11:22:04.675 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:04.675 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:04.676 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 11:21:54.559737159 +0000 2023-10-14T11:22:04.676 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 11:19:09.486473578 +0000 2023-10-14T11:22:04.676 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 11:19:09.486473578 +0000 2023-10-14T11:22:04.676 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T11:22:04.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T11:22:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T11:22:04.743 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T11:22:04.744 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000267998 s, 1.9 MB/s 2023-10-14T11:22:04.745 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T11:22:04.804 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-10-14T11:22:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T11:22:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:04.864 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 384898 Links: 1 2023-10-14T11:22:04.864 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:04.864 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:04.864 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 11:21:54.559737159 +0000 2023-10-14T11:22:04.865 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 11:19:10.021462692 +0000 2023-10-14T11:22:04.865 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 11:19:10.021462692 +0000 2023-10-14T11:22:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T11:22:04.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T11:22:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T11:22:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T11:22:04.933 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000272774 s, 1.9 MB/s 2023-10-14T11:22:04.934 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T11:22:04.994 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-10-14T11:22:05.053 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T11:22:05.053 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 395507 Links: 1 2023-10-14T11:22:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 11:21:54.559737159 +0000 2023-10-14T11:22:05.054 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 11:19:10.540452131 +0000 2023-10-14T11:22:05.055 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 11:19:10.540452131 +0000 2023-10-14T11:22:05.055 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T11:22:05.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T11:22:05.121 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T11:22:05.121 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T11:22:05.121 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000292128 s, 1.8 MB/s 2023-10-14T11:22:05.122 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T11:22:05.181 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-10-14T11:22:05.238 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T11:22:05.238 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T11:22:05.238 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 393580 Links: 1 2023-10-14T11:22:05.238 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T11:22:05.239 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T11:22:05.239 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-10-14 11:21:54.559737159 +0000 2023-10-14T11:22:05.239 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-10-14 11:19:11.071441326 +0000 2023-10-14T11:22:05.239 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-10-14 11:19:11.071441326 +0000 2023-10-14T11:22:05.239 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-10-14T11:22:05.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T11:22:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-10-14T11:22:05.303 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-10-14T11:22:05.304 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000198234 s, 2.6 MB/s 2023-10-14T11:22:05.305 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T11:22:05.362 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:05.363 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T11:22:05.363 INFO:tasks.ceph:Generating config... 2023-10-14T11:22:05.365 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T11:22:05.365 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T11:22:05.366 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T11:22:05.366 INFO:tasks.ceph:[client] pid file = 2023-10-14T11:22:05.367 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T11:22:05.367 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T11:22:05.367 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-14T11:22:05.368 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T11:22:05.368 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T11:22:05.368 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T11:22:05.369 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T11:22:05.369 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T11:22:05.370 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T11:22:05.370 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T11:22:05.371 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T11:22:05.371 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T11:22:05.371 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T11:22:05.372 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T11:22:05.372 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T11:22:05.372 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T11:22:05.373 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T11:22:05.373 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T11:22:05.373 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T11:22:05.373 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-14T11:22:05.374 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-14T11:22:05.374 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-14T11:22:05.374 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T11:22:05.375 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T11:22:05.375 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-14T11:22:05.375 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-14T11:22:05.376 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T11:22:05.376 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T11:22:05.376 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-14T11:22:05.376 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T11:22:05.377 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T11:22:05.377 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T11:22:05.377 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T11:22:05.378 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T11:22:05.378 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T11:22:05.379 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T11:22:05.379 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T11:22:05.444 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T11:22:05.450 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T11:22:05.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:22:05.528 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.b', '172.21.15.72'), ('mon.c', '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]')] 2023-10-14T11:22:05.529 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T11:22:05.530 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:05.531 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T11:22:05.586 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --add b 172.21.15.72 --addv c '[v2:172.21.15.72:3301,v1:172.21.15.72:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:05.676 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:05.676 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid c6e5b03d-6480-4879-8e8f-035e52bef8e2 2023-10-14T11:22:05.677 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = pacific 2023-10-14T11:22:05.677 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2023-10-14T11:22:05.677 INFO:teuthology.orchestra.run.smithi067.stdout:fsid c6e5b03d-6480-4879-8e8f-035e52bef8e2 2023-10-14T11:22:05.677 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2023-10-14T11:22:05.675197+0000 2023-10-14T11:22:05.677 INFO:teuthology.orchestra.run.smithi067.stdout:created 2023-10-14T11:22:05.675197+0000 2023-10-14T11:22:05.678 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 16 (pacific) 2023-10-14T11:22:05.678 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2023-10-14T11:22:05.678 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2023-10-14T11:22:05.678 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.b 2023-10-14T11:22:05.679 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] mon.c 2023-10-14T11:22:05.679 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T11:22:05.680 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T11:22:05.696 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c6e5b03d-6480-4879-8e8f-035e52bef8e2... 2023-10-14T11:22:05.697 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T11:22:05.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T11:22:05.783 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2023-10-14T11:22:05.783 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2023-10-14T11:22:05.784 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T11:22:05.784 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2023-10-14T11:22:05.784 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.784 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2023-10-14T11:22:05.784 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.785 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2023-10-14T11:22:05.785 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.785 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2023-10-14T11:22:05.785 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2023-10-14T11:22:05.785 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.786 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2023-10-14T11:22:05.786 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2023-10-14T11:22:05.786 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.786 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T11:22:05.786 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2023-10-14T11:22:05.787 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.787 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T11:22:05.787 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T11:22:05.787 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.787 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2023-10-14T11:22:05.788 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.788 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2023-10-14T11:22:05.788 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2023-10-14T11:22:05.788 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2023-10-14T11:22:05.788 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2023-10-14T11:22:05.789 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2023-10-14T11:22:05.789 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2023-10-14T11:22:05.789 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2023-10-14T11:22:05.789 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T11:22:05.789 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T11:22:05.790 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2023-10-14T11:22:05.790 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.790 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T11:22:05.790 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.790 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2023-10-14T11:22:05.791 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.791 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2023-10-14T11:22:05.791 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.791 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on skipped message = False 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = c6e5b03d-6480-4879-8e8f-035e52bef8e2 2023-10-14T11:22:05.792 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.793 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2023-10-14T11:22:05.793 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2023-10-14T11:22:05.793 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.793 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2023-10-14T11:22:05.794 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2023-10-14T11:22:05.794 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2023-10-14T11:22:05.794 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.794 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2023-10-14T11:22:05.795 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2023-10-14T11:22:05.795 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.798 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2023-10-14T11:22:05.799 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2023-10-14T11:22:05.799 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2023-10-14T11:22:05.799 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.799 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2023-10-14T11:22:05.800 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2023-10-14T11:22:05.800 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.800 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2023-10-14T11:22:05.800 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.800 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2023-10-14T11:22:05.801 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.801 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2023-10-14T11:22:05.801 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.801 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2023-10-14T11:22:05.801 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2023-10-14T11:22:05.802 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.802 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2023-10-14T11:22:05.802 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2023-10-14T11:22:05.802 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2023-10-14T11:22:05.802 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2023-10-14T11:22:05.803 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2023-10-14T11:22:05.803 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2023-10-14T11:22:05.803 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2023-10-14T11:22:05.803 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2023-10-14T11:22:05.803 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2023-10-14T11:22:05.804 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2023-10-14T11:22:05.805 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2023-10-14T11:22:05.805 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2023-10-14T11:22:05.805 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-10-14T11:22:05.805 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.805 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2023-10-14T11:22:05.806 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-14T11:22:05.806 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2023-10-14T11:22:05.806 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-10-14T11:22:05.806 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-10-14T11:22:05.807 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:22:05.807 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:22:05.807 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2023-10-14T11:22:05.807 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2023-10-14T11:22:05.808 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2023-10-14T11:22:05.809 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2023-10-14T11:22:05.809 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:22:05.809 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2023-10-14T11:22:05.809 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2023-10-14T11:22:05.809 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:22:05.810 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.810 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T11:22:05.810 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T11:22:05.810 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T11:22:05.810 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.811 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T11:22:05.811 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T11:22:05.811 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T11:22:05.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.812 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2023-10-14T11:22:05.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2023-10-14T11:22:05.812 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2023-10-14T11:22:05.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon op complaint time = 120 2023-10-14T11:22:05.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:05.813 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2023-10-14T11:22:05.813 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2023-10-14T11:22:05.813 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2023-10-14T11:22:05.813 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2023-10-14T11:22:05.814 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T11:22:05.814 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T11:22:05.814 INFO:teuthology.orchestra.run.smithi067.stdout: client mount timeout = 600 2023-10-14T11:22:05.814 INFO:teuthology.orchestra.run.smithi067.stdout: debug client = 20 2023-10-14T11:22:05.814 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = "" 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2023-10-14T11:22:05.815 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout:[mds] 2023-10-14T11:22:05.816 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds = 20 2023-10-14T11:22:05.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug mds balancer = 20 2023-10-14T11:22:05.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2023-10-14T11:22:05.817 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug frag = True 2023-10-14T11:22:05.817 INFO:teuthology.orchestra.run.smithi067.stdout: mds debug scatterstat = True 2023-10-14T11:22:05.817 INFO:teuthology.orchestra.run.smithi067.stdout: mds op complaint time = 180 2023-10-14T11:22:05.818 INFO:teuthology.orchestra.run.smithi067.stdout: mds verify scatter = True 2023-10-14T11:22:05.818 INFO:teuthology.orchestra.run.smithi067.stdout: osd op complaint time = 180 2023-10-14T11:22:05.818 INFO:teuthology.orchestra.run.smithi067.stdout: rados mon op timeout = 900 2023-10-14T11:22:05.818 INFO:teuthology.orchestra.run.smithi067.stdout: rados osd op timeout = 900 2023-10-14T11:22:05.942 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-10-14T11:22:05.943 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-10-14T11:22:05.943 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T11:22:05.943 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-10-14T11:22:05.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.944 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-10-14T11:22:05.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.944 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-10-14T11:22:05.944 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.945 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-10-14T11:22:05.945 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-10-14T11:22:05.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.945 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-10-14T11:22:05.946 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-10-14T11:22:05.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T11:22:05.946 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-10-14T11:22:05.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.947 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T11:22:05.947 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T11:22:05.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.947 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-10-14T11:22:05.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.948 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-10-14T11:22:05.948 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-10-14T11:22:05.948 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-10-14T11:22:05.948 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-10-14T11:22:05.949 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-10-14T11:22:05.949 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-10-14T11:22:05.949 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-10-14T11:22:05.949 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T11:22:05.949 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T11:22:05.950 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-10-14T11:22:05.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.950 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T11:22:05.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-10-14T11:22:05.951 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-10-14T11:22:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-10-14T11:22:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.67,172.21.15.72,[v2:172.21.15.72:3301,v1:172.21.15.72:6790]" 2023-10-14T11:22:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2023-10-14T11:22:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = c6e5b03d-6480-4879-8e8f-035e52bef8e2 2023-10-14T11:22:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.953 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-10-14T11:22:05.953 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-10-14T11:22:05.953 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.953 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-10-14T11:22:05.953 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.954 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-10-14T11:22:05.955 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-10-14T11:22:05.955 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-10-14T11:22:05.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.955 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-10-14T11:22:05.955 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-10-14T11:22:05.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.956 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-10-14T11:22:05.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.956 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-10-14T11:22:05.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.957 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-10-14T11:22:05.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.957 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-10-14T11:22:05.957 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-10-14T11:22:05.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.958 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-10-14T11:22:05.958 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-10-14T11:22:05.958 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2023-10-14T11:22:05.958 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2023-10-14T11:22:05.958 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = bitmap 2023-10-14T11:22:05.959 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-10-14T11:22:05.959 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-10-14T11:22:05.959 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2023-10-14T11:22:05.959 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2023-10-14T11:22:05.959 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T11:22:05.960 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-10-14T11:22:05.960 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2023-10-14T11:22:05.960 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T11:22:05.960 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-10-14T11:22:05.960 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-10-14T11:22:05.961 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-10-14T11:22:05.961 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-10-14T11:22:05.961 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-14T11:22:05.961 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.961 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-10-14T11:22:05.962 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T11:22:05.962 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-10-14T11:22:05.962 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-14T11:22:05.962 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-14T11:22:05.962 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T11:22:05.963 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-10-14T11:22:05.964 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-10-14T11:22:05.964 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-10-14T11:22:05.964 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-10-14T11:22:05.964 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-10-14T11:22:05.965 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-10-14T11:22:05.965 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-10-14T11:22:05.965 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-10-14T11:22:05.965 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-10-14T11:22:05.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T11:22:05.966 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T11:22:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T11:22:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-10-14T11:22:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-10-14T11:22:05.967 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.968 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-10-14T11:22:05.968 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-10-14T11:22:05.968 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-10-14T11:22:05.968 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-10-14T11:22:05.968 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-10-14T11:22:05.969 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-10-14T11:22:05.969 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-10-14T11:22:05.969 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T11:22:05.969 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T11:22:05.969 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-10-14T11:22:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-10-14T11:22:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T11:22:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2023-10-14T11:22:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-14T11:22:05.970 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-14T11:22:05.971 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-10-14T11:22:05.971 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-10-14T11:22:05.971 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-10-14T11:22:05.971 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-14T11:22:05.971 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-10-14T11:22:05.972 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-10-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-10-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-10-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-10-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-10-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-10-14T11:22:05.974 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-10-14T11:22:05.974 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-10-14T11:22:05.975 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T11:22:05.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T11:22:06.074 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T11:22:06.074 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:06.075 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T11:22:06.092 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:06.092 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T11:22:06.149 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:22:06.149 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:06.149 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T11:22:06.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:22:06.306 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:06.306 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:06.384 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:22:06.384 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:06.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T11:22:06.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T11:22:06.429 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:06.429 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:06.488 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T11:22:06.489 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T11:22:06.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T11:22:06.546 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T11:22:06.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T11:22:06.772 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T11:22:06.775 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T11:22:06.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T11:22:06.834 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T11:22:06.836 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T11:22:06.864 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T11:22:06.959 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T11:22:06.961 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T11:22:06.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T11:22:07.050 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T11:22:07.053 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T11:22:07.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T11:22:07.177 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T11:22:07.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T11:22:07.206 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T11:22:07.207 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T11:22:07.252 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T11:22:07.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T11:22:07.309 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T11:22:07.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T11:22:07.366 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T11:22:07.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T11:22:07.421 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T11:22:07.433 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T11:22:07.434 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T11:22:07.434 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T11:22:07.461 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:07.461 INFO:tasks.ceph:role: osd.0 2023-10-14T11:22:07.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:22:07.462 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T11:22:07.535 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:07.535 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:07.535 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:07.536 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:07.536 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:07.536 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:07.536 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:07.537 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:07.537 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:07.537 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:07.959 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-14T11:22:07.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-14T11:22:07.961 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T11:22:08.145 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T11:22:08.179 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T11:22:08.247 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:08.247 INFO:tasks.ceph:role: osd.1 2023-10-14T11:22:08.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:22:08.248 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T11:22:08.322 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:08.322 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:08.322 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:08.322 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:08.323 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:08.323 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:08.323 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:08.323 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:08.324 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:08.324 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:08.748 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-14T11:22:08.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-14T11:22:08.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T11:22:08.859 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T11:22:08.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T11:22:08.962 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:08.962 INFO:tasks.ceph:role: osd.2 2023-10-14T11:22:08.962 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:22:08.963 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T11:22:09.036 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:09.037 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:09.037 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:09.037 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:09.037 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:09.038 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:09.038 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:09.038 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:09.038 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:09.038 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:09.487 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-14T11:22:09.489 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-14T11:22:09.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T11:22:09.660 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T11:22:09.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T11:22:09.765 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:09.766 INFO:tasks.ceph:role: osd.3 2023-10-14T11:22:09.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:22:09.766 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T11:22:09.841 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:09.842 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:09.843 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:09.843 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:09.843 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:09.843 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:09.844 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:10.283 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2023-10-14T11:22:10.285 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2023-10-14T11:22:10.286 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T11:22:10.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T11:22:10.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.600+0000 7f0154b6a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T11:22:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.600+0000 7f0154b6a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T11:22:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.600+0000 7f0154b6a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:22:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.600+0000 7f0154b6a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:22:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.600+0000 7f0154b6a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T11:22:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:10.601+0000 7f0154b6a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T11:22:13.485 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T11:22:13.518 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:13.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.608+0000 7fa9587e3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T11:22:13.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.608+0000 7fa9587e3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T11:22:13.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.608+0000 7fa9587e3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:22:13.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.608+0000 7fa9587e3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:22:13.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.608+0000 7fa9587e3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T11:22:13.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:13.609+0000 7fa9587e3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T11:22:16.482 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T11:22:16.515 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:16.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.608+0000 7fa5ae09c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T11:22:16.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.609+0000 7fa5ae09c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T11:22:16.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.609+0000 7fa5ae09c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:22:16.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.609+0000 7fa5ae09c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:22:16.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.609+0000 7fa5ae09c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T11:22:16.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:16.609+0000 7fa5ae09c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T11:22:19.483 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T11:22:19.516 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:19.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T11:22:19.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T11:22:19.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:22:19.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:22:19.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T11:22:19.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:19.608+0000 7f02c3d64640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T11:22:22.469 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T11:22:22.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T11:22:22.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:22.535 INFO:tasks.ceph:role: osd.4 2023-10-14T11:22:22.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:22:22.536 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T11:22:22.613 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:22.614 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:22.614 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:22.615 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:22.615 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:23.050 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T11:22:23.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T11:22:23.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T11:22:23.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T11:22:23.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T11:22:23.345 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:23.345 INFO:tasks.ceph:role: osd.5 2023-10-14T11:22:23.346 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:22:23.346 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T11:22:23.422 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:23.422 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:23.422 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:23.423 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:23.423 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:23.423 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:23.423 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:23.423 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:23.424 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:23.424 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:23.843 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T11:22:23.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T11:22:23.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T11:22:23.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T11:22:23.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T11:22:24.059 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:24.060 INFO:tasks.ceph:role: osd.6 2023-10-14T11:22:24.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:22:24.060 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T11:22:24.136 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:24.136 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:24.137 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:24.137 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:24.137 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:24.137 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:24.137 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:24.138 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:24.138 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:24.138 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:24.574 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T11:22:24.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T11:22:24.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T11:22:24.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T11:22:24.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T11:22:24.823 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T11:22:24.824 INFO:tasks.ceph:role: osd.7 2023-10-14T11:22:24.824 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:22:24.824 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T11:22:24.899 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T11:22:24.899 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T11:22:24.900 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T11:22:24.900 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-14T11:22:24.900 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T11:22:24.900 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-10-14T11:22:24.901 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T11:22:24.901 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-14T11:22:24.901 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T11:22:24.901 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T11:22:25.337 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-10-14T11:22:25.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-10-14T11:22:25.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T11:22:25.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T11:22:25.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T11:22:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T11:22:25.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:22:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:22:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T11:22:25.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:25.713+0000 7f20b4469640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T11:22:28.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T11:22:28.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:28.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.717+0000 7f67169e8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T11:22:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.717+0000 7f67169e8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T11:22:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.717+0000 7f67169e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:22:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.717+0000 7f67169e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:22:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.717+0000 7f67169e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T11:22:28.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:28.718+0000 7f67169e8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T11:22:31.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T11:22:31.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:31.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T11:22:31.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T11:22:31.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:22:31.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:22:31.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T11:22:31.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:31.706+0000 7f7ef669a640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T11:22:33.723 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:33.727 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:22:34.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T11:22:34.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:34.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T11:22:34.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T11:22:34.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:22:34.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:22:34.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T11:22:34.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:34.707+0000 7faf679e2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T11:22:37.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T11:22:37.608 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T11:22:37.609 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T11:22:37.642 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.643 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T11:22:37.714 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.715 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T11:22:37.785 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.786 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T11:22:37.857 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.858 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T11:22:37.927 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T11:22:37.998 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:37.998 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T11:22:38.067 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T11:22:38.099 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T11:22:38.168 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T11:22:38.238 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T11:22:38.306 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T11:22:38.373 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T11:22:38.439 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T11:22:38.506 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:38.506 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T11:22:38.527 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:38.528 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T11:22:38.588 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.589 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T11:22:38.606 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:38.606 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T11:22:38.662 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T11:22:38.662 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T11:22:38.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T11:22:38.705 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2023-10-14T11:22:38.706 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDeeSpl8z2DIBAAvDZwfCoCbv6ynbRGQ1ByCQ== 2023-10-14T11:22:38.706 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.a] 2023-10-14T11:22:38.706 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDeeSplJ+iiMRAABCuddxkrViq7TXTUx4/5TA== 2023-10-14T11:22:38.706 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.c] 2023-10-14T11:22:38.707 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDeeSpl5DMTORAA4eD0zHQvDWvNHO4KXA6sTg== 2023-10-14T11:22:38.707 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2023-10-14T11:22:38.707 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDieSplLyLTIxAALtd64wcm5Xvg7G80tgPSmA== 2023-10-14T11:22:38.707 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2023-10-14T11:22:38.707 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDleSplgxZQJBAAEr3UWT0oNEFhC8oEx9fsUw== 2023-10-14T11:22:38.708 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2023-10-14T11:22:38.708 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDoeSpl4p5VJBAAA0rg6KpUg6T5swksDIn/iA== 2023-10-14T11:22:38.708 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2023-10-14T11:22:38.708 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDreSplnDhHJBAAtOPRyhPw7qn3foE+Ub5Kzg== 2023-10-14T11:22:38.708 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDeeSplq1TzLRAAlo+jQiPBkb9vMq5iivKtyA== 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.b] 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSplZvHzAhAApTdFkHIR7RdOMBuFrMosvQ== 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout:[mds.d] 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSplX32HChAA3B2RIKaKVTsN3RJz80uIUw== 2023-10-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2023-10-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDxeSpl8zGJKhAAV1ydfxZw1ujqv9PsNDttZQ== 2023-10-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2023-10-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQD0eSplyFfJKhAAmPvyNlqP3KDJKCVnHEd9Cw== 2023-10-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2023-10-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQD3eSpludAsKhAAhDFPElXDSx4mmNAo/qHPQg== 2023-10-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2023-10-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQD6eSpl/3s8KhAAF40m9fPo9NERpxOh8hoAog== 2023-10-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2023-10-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSpl8t3yDhAAAGu18U/fwYpuJy9KZfW1kg== 2023-10-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi067.stdout:[client.2] 2023-10-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSplWwpdEhAA9qPy8pk4jnXaskyacPUEtw== 2023-10-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2023-10-14T11:22:38.713 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSplOTzKFRAAJPIpBhDluCFDXp20fsl3Zg== 2023-10-14T11:22:38.713 INFO:teuthology.orchestra.run.smithi067.stdout:[client.3] 2023-10-14T11:22:38.713 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSpljU0HGRAAWXxjMfTTvVWCGSKFM2eopQ== 2023-10-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-10-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDeeSpl8z2DIBAAvDZwfCoCbv6ynbRGQ1ByCQ== 2023-10-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-10-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDeeSplJ+iiMRAABCuddxkrViq7TXTUx4/5TA== 2023-10-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-10-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDeeSpl5DMTORAA4eD0zHQvDWvNHO4KXA6sTg== 2023-10-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-10-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDieSplLyLTIxAALtd64wcm5Xvg7G80tgPSmA== 2023-10-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-10-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDleSplgxZQJBAAEr3UWT0oNEFhC8oEx9fsUw== 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDoeSpl4p5VJBAAA0rg6KpUg6T5swksDIn/iA== 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDreSplnDhHJBAAtOPRyhPw7qn3foE+Ub5Kzg== 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-10-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDeeSplq1TzLRAAlo+jQiPBkb9vMq5iivKtyA== 2023-10-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-10-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSplZvHzAhAApTdFkHIR7RdOMBuFrMosvQ== 2023-10-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-10-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSplX32HChAA3B2RIKaKVTsN3RJz80uIUw== 2023-10-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-10-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDxeSpl8zGJKhAAV1ydfxZw1ujqv9PsNDttZQ== 2023-10-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-10-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD0eSplyFfJKhAAmPvyNlqP3KDJKCVnHEd9Cw== 2023-10-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-10-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD3eSpludAsKhAAhDFPElXDSx4mmNAo/qHPQg== 2023-10-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-10-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD6eSpl/3s8KhAAF40m9fPo9NERpxOh8hoAog== 2023-10-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-10-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSpl8t3yDhAAAGu18U/fwYpuJy9KZfW1kg== 2023-10-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2023-10-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSplWwpdEhAA9qPy8pk4jnXaskyacPUEtw== 2023-10-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-10-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSplOTzKFRAAJPIpBhDluCFDXp20fsl3Zg== 2023-10-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2023-10-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDfeSpljU0HGRAAWXxjMfTTvVWCGSKFM2eopQ== 2023-10-14T11:22:38.735 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:22:38.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:22:38.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:38.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:38.890 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:38.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:38.949 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:38.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.114 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.169 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:22:39.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T11:22:39.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:39.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:39.285 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:39.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T11:22:39.344 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.347 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.510 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T11:22:39.566 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.624 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.683 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T11:22:39.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T11:22:39.800 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T11:22:39.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:22:39.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T11:22:39.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T11:22:39.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:22:40.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T11:22:40.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T11:22:40.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T11:22:40.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T11:22:40.296 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:40.299 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T11:22:40.353 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T11:22:40.354 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T11:22:40.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T11:22:40.357 INFO:tasks.ceph.mon.a:Started 2023-10-14T11:22:40.357 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T11:22:40.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T11:22:40.396 INFO:tasks.ceph.mon.b:Started 2023-10-14T11:22:40.396 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T11:22:40.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T11:22:40.398 INFO:tasks.ceph.mon.c:Started 2023-10-14T11:22:40.399 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T11:22:40.399 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T11:22:40.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T11:22:40.402 INFO:tasks.ceph.mgr.y:Started 2023-10-14T11:22:40.402 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T11:22:40.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T11:22:40.405 INFO:tasks.ceph.mgr.x:Started 2023-10-14T11:22:40.405 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T11:22:40.405 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T11:22:40.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.530+0000 7ff51da71700 1 Processor -- start 2023-10-14T11:22:40.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.530+0000 7ff51da71700 1 -- start start 2023-10-14T11:22:40.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff51da71700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 0x7ff51806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff51da71700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 0x7ff51815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff51da71700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51815fe10 con 0x7ff5180b08d0 2023-10-14T11:22:40.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff51da71700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51815bee0 con 0x7ff5180b1140 2023-10-14T11:22:40.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff51da71700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51815cd20 con 0x7ff51815f4d0 2023-10-14T11:22:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff5177fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff5180b08d0 0x7ff51815c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:39984/0 (socket says 172.21.15.67:39984) 2023-10-14T11:22:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff516ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 0x7ff51806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff5177fe700 1 -- 172.21.15.67:0/1518177429 learned_addr learned my addr 172.21.15.67:0/1518177429 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:40.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.531+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 0x7ff51815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff516ffd700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 msgr2=0x7ff51806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff516ffd700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 msgr2=0x7ff51806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff516ffd700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 0x7ff51806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 msgr2=0x7ff51815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff516ffd700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 0x7ff51806b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T11:22:40.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 msgr2=0x7ff51815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T11:22:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 0x7ff51815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T11:22:40.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.532+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 0x7ff51815f8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T11:22:40.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.727+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614426725 0 0) 0x7ff51815fe10 con 0x7ff5180b08d0 2023-10-14T11:22:40.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.727+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5000035b0 con 0x7ff5180b08d0 2023-10-14T11:22:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113310588 0 0) 0x7ff5000035b0 con 0x7ff5180b08d0 2023-10-14T11:22:40.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 msgr2=0x7ff51815f8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:22:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.72:3300/0 conn(0x7ff51815f4d0 0x7ff51815f8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 msgr2=0x7ff51806b1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:22:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 --2- 172.21.15.67:0/1518177429 >> v2:172.21.15.67:3300/0 conn(0x7ff5180b1140 0x7ff51806b1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180b15d0 con 0x7ff5180b08d0 2023-10-14T11:22:40.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7ff5080019f0 con 0x7ff5180b08d0 2023-10-14T11:22:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 >> v1:172.21.15.67:6789/0 conn(0x7ff5180b08d0 legacy=0x7ff51815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff500003a00 0x7ff500003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff500004850 0x7ff500004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff50000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51815bee0 con 0x7ff500005210 2023-10-14T11:22:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51815cd20 con 0x7ff500003a00 2023-10-14T11:22:40.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff500010520 con 0x7ff500004850 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff5177fe700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff500003a00 0x7ff500003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff50000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.728+0000 7ff516ffd700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff500004850 0x7ff500004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff500004850 msgr2=0x7ff500004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff500004850 0x7ff500004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff500003a00 msgr2=0x7ff500003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff500003a00 0x7ff500003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000035b0 con 0x7ff500005210 2023-10-14T11:22:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff516ffd700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff500004850 0x7ff500004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff5177fe700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff500003a00 0x7ff500003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:40.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 -- 172.21.15.67:0/1518177429 reap_dead start 2023-10-14T11:22:40.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff517fff700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff50000ba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff510009890 tx=0x7ff500005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd89e91edc2de1c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:40.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000c070 con 0x7ff500005210 2023-10-14T11:22:40.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510004020 con 0x7ff500005210 2023-10-14T11:22:40.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.729+0000 7ff5167fc700 1 -- 172.21.15.67:0/1518177429 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5100043b0 con 0x7ff500005210 2023-10-14T11:22:40.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 -- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 msgr2=0x7ff50000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:40.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff50000ba10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff510009890 tx=0x7ff500005880 comp rx=0 tx=0).stop 2023-10-14T11:22:40.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 -- 172.21.15.67:0/1518177429 shutdown_connections 2023-10-14T11:22:40.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 --2- 172.21.15.67:0/1518177429 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff50000ba10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 -- 172.21.15.67:0/1518177429 >> 172.21.15.67:0/1518177429 conn(0x7ff5180d04b0 msgr2=0x7ff5180d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:40.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 -- 172.21.15.67:0/1518177429 shutdown_connections 2023-10-14T11:22:40.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.730+0000 7ff51da71700 1 -- 172.21.15.67:0/1518177429 wait complete. 2023-10-14T11:22:40.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.732+0000 7ff51da71700 1 Processor -- start 2023-10-14T11:22:40.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.732+0000 7ff51da71700 1 -- start start 2023-10-14T11:22:40.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff518145c20 0x7ff51813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff51813ef50 0x7ff51813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180b33a0 con 0x7ff500005210 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51806e660 con 0x7ff518145c20 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff51da71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180b3640 con 0x7ff51813ef50 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff516ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff518145c20 0x7ff51813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40722/0 (socket says 172.21.15.67:40722) 2023-10-14T11:22:40.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff517fff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff51813ef50 0x7ff51813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:40.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 -- 172.21.15.67:0/1884549063 learned_addr learned my addr 172.21.15.67:0/1884549063 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:40.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 -- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff51813ef50 msgr2=0x7ff51813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:40.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff51813ef50 0x7ff51813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 -- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff518145c20 msgr2=0x7ff51813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:40.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff518145c20 0x7ff51813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.733+0000 7ff5177fe700 1 -- 172.21.15.67:0/1884549063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51806e920 con 0x7ff500005210 2023-10-14T11:22:40.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.734+0000 7ff5177fe700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff508001b60 tx=0x7ff508007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:40.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508013600 con 0x7ff500005210 2023-10-14T11:22:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff508013760 con 0x7ff500005210 2023-10-14T11:22:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518142a50 con 0x7ff500005210 2023-10-14T11:22:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508013b10 con 0x7ff500005210 2023-10-14T11:22:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff518140050 con 0x7ff500005210 2023-10-14T11:22:40.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff508013c70 con 0x7ff500005210 2023-10-14T11:22:40.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.735+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff50801cd50 con 0x7ff500005210 2023-10-14T11:22:40.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.736+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180b1b40 con 0x7ff500005210 2023-10-14T11:22:40.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.738+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff50803bb40 con 0x7ff500005210 2023-10-14T11:22:40.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.816+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff51804ebb0 con 0x7ff500005210 2023-10-14T11:22:40.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.817+0000 7ff4fffff700 1 -- 172.21.15.67:0/1884549063 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff50802a070 con 0x7ff500005210 2023-10-14T11:22:40.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 msgr2=0x7ff518152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:40.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff508001b60 tx=0x7ff508007670 comp rx=0 tx=0).stop 2023-10-14T11:22:40.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 shutdown_connections 2023-10-14T11:22:40.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff51813ef50 0x7ff51813f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff500005210 0x7ff518152c10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 --2- 172.21.15.67:0/1884549063 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff518145c20 0x7ff51813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:40.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 >> 172.21.15.67:0/1884549063 conn(0x7ff5180d04b0 msgr2=0x7ff518155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:40.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 shutdown_connections 2023-10-14T11:22:40.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:40.818+0000 7ff51da71700 1 -- 172.21.15.67:0/1884549063 wait complete. 2023-10-14T11:22:40.822 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2023-10-14T11:22:40.833 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T11:22:40.833 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T11:22:40.833 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:40.834 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T11:22:40.845 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:40.842+0000 7ff87d92e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T11:22:40.854 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:40.852+0000 7f0a955a3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T11:22:40.861 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:40.861 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T11:22:40.909 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:40.907+0000 7ff87d92e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T11:22:40.927 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:40.925+0000 7f0a955a3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T11:22:40.928 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:40.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T11:22:40.985 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:40.982+0000 7ff87d92e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T11:22:40.995 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:22:40.995 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T11:22:41.008 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.006+0000 7f0a955a3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T11:22:41.035 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:41.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T11:22:41.063 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:41.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T11:22:41.065 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.062+0000 7ff87d92e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T11:22:41.089 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:41.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T11:22:41.092 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.091+0000 7f0a955a3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T11:22:41.156 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:22:41.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T11:22:41.213 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.210+0000 7ff87d92e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T11:22:41.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new c9dd6efa-3c88-45de-9a0e-eb15395fce91 0 2023-10-14T11:22:41.242 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.240+0000 7f0a955a3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T11:22:41.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.380+0000 7f872c1f7700 1 Processor -- start 2023-10-14T11:22:41.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 -- start start 2023-10-14T11:22:41.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f872415aa60 0x7f87240ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240d1300 con 0x7f872415aa60 2023-10-14T11:22:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87240cd380 con 0x7f87240ccf00 2023-10-14T11:22:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.381+0000 7f872c1f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240ad3c0 con 0x7f872415ae40 2023-10-14T11:22:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f872a794700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f872a794700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46458/0 (socket says 172.21.15.72:46458) 2023-10-14T11:22:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38122/0 (socket says 172.21.15.72:38122) 2023-10-14T11:22:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f872a794700 1 -- 172.21.15.72:0/1399286628 learned_addr learned my addr 172.21.15.72:0/1399286628 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729f93700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.67:3300/0 conn(0x7f872415aa60 0x7f87240ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 -- 172.21.15.72:0/1399286628 >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 msgr2=0x7f87240ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 -- 172.21.15.72:0/1399286628 >> v2:172.21.15.67:3300/0 conn(0x7f872415aa60 msgr2=0x7f87240ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.67:3300/0 conn(0x7f872415aa60 0x7f87240ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 -- 172.21.15.72:0/1399286628 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240ce8f0 con 0x7f872415ae40 2023-10-14T11:22:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f872a794700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8729792700 1 --2- 172.21.15.72:0/1399286628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f872415e6e0 tx=0x7f8714009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84b1cefd58849ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8728f91700 1 -- 172.21.15.72:0/1399286628 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714011830 con 0x7f872415ae40 2023-10-14T11:22:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8728f91700 1 -- 172.21.15.72:0/1399286628 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714011990 con 0x7f872415ae40 2023-10-14T11:22:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.382+0000 7f8728f91700 1 -- 172.21.15.72:0/1399286628 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714011d20 con 0x7f872415ae40 2023-10-14T11:22:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 -- 172.21.15.72:0/1399286628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 msgr2=0x7f87240cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 --2- 172.21.15.72:0/1399286628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f872415e6e0 tx=0x7f8714009b20 comp rx=0 tx=0).stop 2023-10-14T11:22:41.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 -- 172.21.15.72:0/1399286628 shutdown_connections 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.72:3300/0 conn(0x7f87240ccf00 0x7f87240ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 --2- 172.21.15.72:0/1399286628 >> v2:172.21.15.67:3300/0 conn(0x7f872415aa60 0x7f87240ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 --2- 172.21.15.72:0/1399286628 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240cc9c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 -- 172.21.15.72:0/1399286628 >> 172.21.15.72:0/1399286628 conn(0x7f87240d04b0 msgr2=0x7f87240d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 -- 172.21.15.72:0/1399286628 shutdown_connections 2023-10-14T11:22:41.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.383+0000 7f872c1f7700 1 -- 172.21.15.72:0/1399286628 wait complete. 2023-10-14T11:22:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.384+0000 7f872c1f7700 1 Processor -- start 2023-10-14T11:22:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.384+0000 7f872c1f7700 1 -- start start 2023-10-14T11:22:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87240ccf00 0x7f872406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b0540 con 0x7f87240ccf00 2023-10-14T11:22:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240c88b0 con 0x7f872415aa60 2023-10-14T11:22:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240c8b90 con 0x7f872415ae40 2023-10-14T11:22:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872a794700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46462/0 (socket says 172.21.15.72:46462) 2023-10-14T11:22:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 -- 172.21.15.72:0/3896967916 learned_addr learned my addr 172.21.15.72:0/3896967916 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 -- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 msgr2=0x7f87240b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 -- 172.21.15.72:0/3896967916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87240ccf00 msgr2=0x7f872406aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87240ccf00 0x7f872406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 -- 172.21.15.72:0/3896967916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c009b30 con 0x7f872415aa60 2023-10-14T11:22:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872a794700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f8729792700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8714009b60 tx=0x7f8714004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714004510 con 0x7f872415aa60 2023-10-14T11:22:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871401e070 con 0x7f872415aa60 2023-10-14T11:22:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87140094a0 con 0x7f872415aa60 2023-10-14T11:22:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.385+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140038e0 con 0x7f872415aa60 2023-10-14T11:22:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.386+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87240c9150 con 0x7f872415aa60 2023-10-14T11:22:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.386+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8714003d40 con 0x7f872415aa60 2023-10-14T11:22:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.386+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f871402dca0 con 0x7f872415aa60 2023-10-14T11:22:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.387+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872404ebb0 con 0x7f872415aa60 2023-10-14T11:22:41.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.389+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f8714020070 con 0x7f872415aa60 2023-10-14T11:22:41.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.470+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9dd6efa-3c88-45de-9a0e-eb15395fce91", "id": 0} v 0) v1 -- 0x7f87240b2dc0 con 0x7f872415aa60 2023-10-14T11:22:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.476+0000 7f871a7fc700 1 -- 172.21.15.72:0/3896967916 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9dd6efa-3c88-45de-9a0e-eb15395fce91", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8714015020 con 0x7f872415aa60 2023-10-14T11:22:41.479 INFO:teuthology.orchestra.run.smithi072.stdout:0 2023-10-14T11:22:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 msgr2=0x7f87240b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8714009b60 tx=0x7f8714004750 comp rx=0 tx=0).stop 2023-10-14T11:22:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 shutdown_connections 2023-10-14T11:22:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f872415ae40 0x7f87240b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f87240ccf00 0x7f872406aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 --2- 172.21.15.72:0/3896967916 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f872415aa60 0x7f87240b0b70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 >> 172.21.15.72:0/3896967916 conn(0x7f87240d04b0 msgr2=0x7f87241e4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 shutdown_connections 2023-10-14T11:22:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.477+0000 7f872c1f7700 1 -- 172.21.15.72:0/3896967916 wait complete. 2023-10-14T11:22:41.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new d3f92ea5-a127-4806-b0f5-868bb76022e3 1 2023-10-14T11:22:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.608+0000 7f6318e69700 1 Processor -- start 2023-10-14T11:22:41.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.608+0000 7f6318e69700 1 -- start start 2023-10-14T11:22:41.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6318e69700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63140cd0d0 0x7f63140ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6318e69700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140ad3c0 con 0x7f631415aa60 2023-10-14T11:22:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6318e69700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63140ce8f0 con 0x7f631415ae40 2023-10-14T11:22:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6318e69700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63140d1300 con 0x7f63140cd0d0 2023-10-14T11:22:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6312d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f631415ae40 0x7f63140cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57986/0 (socket says 172.21.15.72:57986) 2023-10-14T11:22:41.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6312d9d700 1 -- 172.21.15.72:0/3089494291 learned_addr learned my addr 172.21.15.72:0/3089494291 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T11:22:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.609+0000 7f6311d9b700 1 --2- 172.21.15.72:0/3089494291 >> v2:172.21.15.67:3300/0 conn(0x7f63140cd0d0 0x7f63140ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f631159a700 1 -- 172.21.15.72:0/3089494291 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581746362 0 0) 0x7f63140ce8f0 con 0x7f631415ae40 2023-10-14T11:22:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f631159a700 1 -- 172.21.15.72:0/3089494291 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62fc0035b0 con 0x7f631415ae40 2023-10-14T11:22:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f6311d9b700 1 -- 172.21.15.72:0/3089494291 >> v1:172.21.15.72:6789/0 conn(0x7f631415ae40 legacy=0x7f63140cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f6311d9b700 1 -- 172.21.15.72:0/3089494291 >> v1:172.21.15.67:6789/0 conn(0x7f631415aa60 legacy=0x7f63140cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f6311d9b700 1 -- 172.21.15.72:0/3089494291 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140ceb50 con 0x7f63140cd0d0 2023-10-14T11:22:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f6311d9b700 1 --2- 172.21.15.72:0/3089494291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140ce3b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6308009840 tx=0x7f6308009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c242982e3b3d073 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f631159a700 1 -- 172.21.15.72:0/3089494291 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308011830 con 0x7f63140cd0d0 2023-10-14T11:22:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f631159a700 1 -- 172.21.15.72:0/3089494291 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308011990 con 0x7f63140cd0d0 2023-10-14T11:22:41.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.610+0000 7f631159a700 1 -- 172.21.15.72:0/3089494291 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308011d00 con 0x7f63140cd0d0 2023-10-14T11:22:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 -- 172.21.15.72:0/3089494291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 msgr2=0x7f63140ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 --2- 172.21.15.72:0/3089494291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140ce3b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6308009840 tx=0x7f6308009b50 comp rx=0 tx=0).stop 2023-10-14T11:22:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 -- 172.21.15.72:0/3089494291 shutdown_connections 2023-10-14T11:22:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 --2- 172.21.15.72:0/3089494291 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140ce3b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 -- 172.21.15.72:0/3089494291 >> 172.21.15.72:0/3089494291 conn(0x7f63140d04b0 msgr2=0x7f63140d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 -- 172.21.15.72:0/3089494291 shutdown_connections 2023-10-14T11:22:41.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.611+0000 7f6318e69700 1 -- 172.21.15.72:0/3089494291 wait complete. 2023-10-14T11:22:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.612+0000 7f6318e69700 1 Processor -- start 2023-10-14T11:22:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.612+0000 7f6318e69700 1 -- start start 2023-10-14T11:22:41.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631415ae40 0x7f6314146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b1040 con 0x7f63140cd0d0 2023-10-14T11:22:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140ca340 con 0x7f631415aa60 2023-10-14T11:22:41.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b0430 con 0x7f631415ae40 2023-10-14T11:22:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46474/0 (socket says 172.21.15.72:46474) 2023-10-14T11:22:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 -- 172.21.15.72:0/3060657823 learned_addr learned my addr 172.21.15.72:0/3060657823 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:41.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6312d9d700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631415ae40 0x7f6314146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f631259c700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 -- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631415ae40 msgr2=0x7f6314146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631415ae40 0x7f6314146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 -- 172.21.15.72:0/3060657823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 msgr2=0x7f63140c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 -- 172.21.15.72:0/3060657823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080094a0 con 0x7f631415aa60 2023-10-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f631259c700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6311d9b700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6308009fd0 tx=0x7f6308004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308004550 con 0x7f631415aa60 2023-10-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630801e070 con 0x7f631415aa60 2023-10-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63140b0710 con 0x7f631415aa60 2023-10-14T11:22:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.613+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080038e0 con 0x7f631415aa60 2023-10-14T11:22:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.614+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63140b0cd0 con 0x7f631415aa60 2023-10-14T11:22:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.614+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6308003d40 con 0x7f631415aa60 2023-10-14T11:22:41.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.614+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f630801a7d0 con 0x7f631415aa60 2023-10-14T11:22:41.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.615+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631404ebb0 con 0x7f631415aa60 2023-10-14T11:22:41.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.617+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6308020070 con 0x7f631415aa60 2023-10-14T11:22:41.636 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.633+0000 7ff87d92e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T11:22:41.650 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.649+0000 7f0a955a3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T11:22:41.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.701+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d3f92ea5-a127-4806-b0f5-868bb76022e3", "id": 1} v 0) v1 -- 0x7f631406b0b0 con 0x7f631415aa60 2023-10-14T11:22:41.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.709+0000 7f6302ffd700 1 -- 172.21.15.72:0/3060657823 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3f92ea5-a127-4806-b0f5-868bb76022e3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6308015020 con 0x7f631415aa60 2023-10-14T11:22:41.712 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T11:22:41.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 msgr2=0x7f6314146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6308009fd0 tx=0x7f6308004750 comp rx=0 tx=0).stop 2023-10-14T11:22:41.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 shutdown_connections 2023-10-14T11:22:41.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f631415ae40 0x7f6314146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63140cd0d0 0x7f63140c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 --2- 172.21.15.72:0/3060657823 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f631415aa60 0x7f6314146130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 >> 172.21.15.72:0/3060657823 conn(0x7f63140d04b0 msgr2=0x7f63140cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 shutdown_connections 2023-10-14T11:22:41.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.710+0000 7f6318e69700 1 -- 172.21.15.72:0/3060657823 wait complete. 2023-10-14T11:22:41.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 05452499-a0b7-449d-b8e0-3b9482ad621a 2 2023-10-14T11:22:41.759 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.756+0000 7ff87d92e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T11:22:41.774 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.772+0000 7f0a955a3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T11:22:41.846 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.843+0000 7ff87d92e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T11:22:41.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.844+0000 7fc6b9e48700 1 Processor -- start 2023-10-14T11:22:41.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.844+0000 7fc6b9e48700 1 -- start start 2023-10-14T11:22:41.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.844+0000 7fc6b9e48700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 0x7fc6b40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b9e48700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40b0f90 con 0x7fc6b406b3b0 2023-10-14T11:22:41.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b9e48700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40cc820 con 0x7fc6b40b1250 2023-10-14T11:22:41.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b9e48700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40cde00 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 0x7fc6b40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc6b40b1250 0x7fc6b40cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57998/0 (socket says 172.21.15.72:57998) 2023-10-14T11:22:41.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b3fff700 1 -- 172.21.15.72:0/401369665 learned_addr learned my addr 172.21.15.72:0/401369665 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b37fe700 1 -- 172.21.15.72:0/401369665 >> v1:172.21.15.72:6789/0 conn(0x7fc6b40b1250 legacy=0x7fc6b40cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b37fe700 1 -- 172.21.15.72:0/401369665 >> v1:172.21.15.67:6789/0 conn(0x7fc6b406b3b0 legacy=0x7fc6b40cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b27fc700 1 -- 172.21.15.72:0/401369665 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275789362 0 0) 0x7fc6b40cc820 con 0x7fc6b40b1250 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b37fe700 1 -- 172.21.15.72:0/401369665 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40ccb00 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b37fe700 1 --2- 172.21.15.72:0/401369665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 0x7fc6b40cd8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36214624ac83f085 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b27fc700 1 -- 172.21.15.72:0/401369665 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011830 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b27fc700 1 -- 172.21.15.72:0/401369665 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4011990 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.845+0000 7fc6b27fc700 1 -- 172.21.15.72:0/401369665 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011d20 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 -- 172.21.15.72:0/401369665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 msgr2=0x7fc6b40cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/401369665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 0x7fc6b40cd8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009870 tx=0x7fc6a4009b80 comp rx=0 tx=0).stop 2023-10-14T11:22:41.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 -- 172.21.15.72:0/401369665 shutdown_connections 2023-10-14T11:22:41.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/401369665 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b40b0bb0 0x7fc6b40cd8c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 -- 172.21.15.72:0/401369665 >> 172.21.15.72:0/401369665 conn(0x7fc6b40d04b0 msgr2=0x7fc6b40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 -- 172.21.15.72:0/401369665 shutdown_connections 2023-10-14T11:22:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.846+0000 7fc6b9e48700 1 -- 172.21.15.72:0/401369665 wait complete. 2023-10-14T11:22:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.847+0000 7fc6b9e48700 1 Processor -- start 2023-10-14T11:22:41.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.847+0000 7fc6b9e48700 1 -- start start 2023-10-14T11:22:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 0x7fc6b40c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b40b1250 0x7fc6b41e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b415e570 con 0x7fc6b40b0bb0 2023-10-14T11:22:41.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c7ac0 con 0x7fc6b40b1250 2023-10-14T11:22:41.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b9e48700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b40c8570 con 0x7fc6b406b3b0 2023-10-14T11:22:41.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b40b1250 0x7fc6b41e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b37fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38150/0 (socket says 172.21.15.72:38150) 2023-10-14T11:22:41.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b37fe700 1 -- 172.21.15.72:0/994635062 learned_addr learned my addr 172.21.15.72:0/994635062 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.848+0000 7fc6b2ffd700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 0x7fc6b40c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 -- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b40b1250 msgr2=0x7fc6b41e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b40b1250 0x7fc6b41e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 -- 172.21.15.72:0/994635062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 msgr2=0x7fc6b40c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 0x7fc6b40c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 -- 172.21.15.72:0/994635062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40094a0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b2ffd700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 0x7fc6b40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b37fe700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40038a0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a401f070 con 0x7fc6b406b3b0 2023-10-14T11:22:41.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b40c7cd0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4003c00 con 0x7fc6b406b3b0 2023-10-14T11:22:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b40c8290 con 0x7fc6b406b3b0 2023-10-14T11:22:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc6a4026780 con 0x7fc6b406b3b0 2023-10-14T11:22:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.849+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc6a4021070 con 0x7fc6b406b3b0 2023-10-14T11:22:41.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.850+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b415e2d0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.852+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc6b415e2d0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.864 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.863+0000 7f0a955a3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T11:22:41.929 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:41.926+0000 7ff87d92e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.936+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "05452499-a0b7-449d-b8e0-3b9482ad621a", "id": 2} v 0) v1 -- 0x7fc6b415e6b0 con 0x7fc6b406b3b0 2023-10-14T11:22:41.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.941+0000 7fc69bfff700 1 -- 172.21.15.72:0/994635062 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05452499-a0b7-449d-b8e0-3b9482ad621a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6a4015020 con 0x7fc6b406b3b0 2023-10-14T11:22:41.944 INFO:teuthology.orchestra.run.smithi072.stdout:2 2023-10-14T11:22:41.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 msgr2=0x7fc6b40c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:41.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000c00 tx=0x7fc6a4004750 comp rx=0 tx=0).stop 2023-10-14T11:22:41.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 shutdown_connections 2023-10-14T11:22:41.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b40b1250 0x7fc6b41e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b406b3b0 0x7fc6b40c9260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 --2- 172.21.15.72:0/994635062 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b40b0bb0 0x7fc6b40c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:41.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 >> 172.21.15.72:0/994635062 conn(0x7fc6b40d04b0 msgr2=0x7fc6b415da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:41.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 shutdown_connections 2023-10-14T11:22:41.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:41.942+0000 7fc6b9e48700 1 -- 172.21.15.72:0/994635062 wait complete. 2023-10-14T11:22:41.950 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:41.948+0000 7f0a955a3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T11:22:41.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new fbe9cb99-fba8-4821-ba7b-b803a6476cd9 3 2023-10-14T11:22:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 Processor -- start 2023-10-14T11:22:42.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 -- start start 2023-10-14T11:22:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f81f0066be0 0x7f81f015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.117+0000 7f81f5b6f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f015f480 con 0x7f81f0066be0 2023-10-14T11:22:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81f5b6f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00cc510 con 0x7f81f006e770 2023-10-14T11:22:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81f5b6f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f015f6d0 con 0x7f81f006eb50 2023-10-14T11:22:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38158/0 (socket says 172.21.15.72:38158) 2023-10-14T11:22:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ef7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46490/0 (socket says 172.21.15.72:46490) 2023-10-14T11:22:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ef7fe700 1 -- 172.21.15.72:0/2417995139 learned_addr learned my addr 172.21.15.72:0/2417995139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81effff700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.67:3300/0 conn(0x7f81f0066be0 0x7f81f015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 -- 172.21.15.72:0/2417995139 >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 msgr2=0x7f81f006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 -- 172.21.15.72:0/2417995139 >> v2:172.21.15.67:3300/0 conn(0x7f81f0066be0 msgr2=0x7f81f015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.67:3300/0 conn(0x7f81f0066be0 0x7f81f015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 -- 172.21.15.72:0/2417995139 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f015f9b0 con 0x7f81f006eb50 2023-10-14T11:22:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ef7fe700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:42.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2417995139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81f0073000 tx=0x7f81e4009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3d74d66c8db2c80 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ee7fc700 1 -- 172.21.15.72:0/2417995139 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011830 con 0x7f81f006eb50 2023-10-14T11:22:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ee7fc700 1 -- 172.21.15.72:0/2417995139 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4011990 con 0x7f81f006eb50 2023-10-14T11:22:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.118+0000 7f81ee7fc700 1 -- 172.21.15.72:0/2417995139 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4011d20 con 0x7f81f006eb50 2023-10-14T11:22:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2417995139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 msgr2=0x7f81f00666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2417995139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f81f0073000 tx=0x7f81e4009b20 comp rx=0 tx=0).stop 2023-10-14T11:22:42.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2417995139 shutdown_connections 2023-10-14T11:22:42.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.67:3300/0 conn(0x7f81f0066be0 0x7f81f015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2417995139 >> v2:172.21.15.72:3300/0 conn(0x7f81f006e770 0x7f81f006a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2417995139 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006eb50 0x7f81f00666a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2417995139 >> 172.21.15.72:0/2417995139 conn(0x7f81f00b1760 msgr2=0x7f81f00b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2417995139 shutdown_connections 2023-10-14T11:22:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.119+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2417995139 wait complete. 2023-10-14T11:22:42.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.120+0000 7f81f5b6f700 1 Processor -- start 2023-10-14T11:22:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 -- start start 2023-10-14T11:22:42.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f006eb50 0x7f81f006b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c9dc0 con 0x7f81f006eb50 2023-10-14T11:22:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c5650 con 0x7f81f0066be0 2023-10-14T11:22:42.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81f5b6f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c47a0 con 0x7f81f006e770 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38164/0 (socket says 172.21.15.72:38164) 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46496/0 (socket says 172.21.15.72:46496) 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.121+0000 7f81eeffd700 1 -- 172.21.15.72:0/2769342427 learned_addr learned my addr 172.21.15.72:0/2769342427 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81effff700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f006eb50 0x7f81f006b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 -- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 msgr2=0x7f81f0158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 -- 172.21.15.72:0/2769342427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f006eb50 msgr2=0x7f81f006b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f006eb50 0x7f81f006b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 -- 172.21.15.72:0/2769342427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0009550 con 0x7f81f006e770 2023-10-14T11:22:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81ef7fe700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81eeffd700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009b60 tx=0x7f81e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004510 con 0x7f81f006e770 2023-10-14T11:22:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e401f070 con 0x7f81f006e770 2023-10-14T11:22:42.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e40094a0 con 0x7f81f006e770 2023-10-14T11:22:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40038e0 con 0x7f81f006e770 2023-10-14T11:22:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f00c4d20 con 0x7f81f006e770 2023-10-14T11:22:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f81e4003d40 con 0x7f81f006e770 2023-10-14T11:22:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.122+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f81e4021070 con 0x7f81f006e770 2023-10-14T11:22:42.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.123+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f004ebb0 con 0x7f81f006e770 2023-10-14T11:22:42.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.125+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f81e4015020 con 0x7f81f006e770 2023-10-14T11:22:42.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.208+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fbe9cb99-fba8-4821-ba7b-b803a6476cd9", "id": 3} v 0) v1 -- 0x7f81f00724a0 con 0x7f81f006e770 2023-10-14T11:22:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.213+0000 7f81d7fff700 1 -- 172.21.15.72:0/2769342427 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbe9cb99-fba8-4821-ba7b-b803a6476cd9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81e4026d20 con 0x7f81f006e770 2023-10-14T11:22:42.216 INFO:teuthology.orchestra.run.smithi072.stdout:3 2023-10-14T11:22:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 msgr2=0x7f81f00c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009b60 tx=0x7f81e4004750 comp rx=0 tx=0).stop 2023-10-14T11:22:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 shutdown_connections 2023-10-14T11:22:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f81f006eb50 0x7f81f006b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f0066be0 0x7f81f0158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 --2- 172.21.15.72:0/2769342427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f81f006e770 0x7f81f00c5df0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 >> 172.21.15.72:0/2769342427 conn(0x7f81f00b1760 msgr2=0x7f81f015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 shutdown_connections 2023-10-14T11:22:42.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.214+0000 7f81f5b6f700 1 -- 172.21.15.72:0/2769342427 wait complete. 2023-10-14T11:22:42.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 116cac62-68b9-4079-a39e-c8145c3b4e7a 4 2023-10-14T11:22:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.345+0000 7f94b03e0700 1 Processor -- start 2023-10-14T11:22:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.345+0000 7f94b03e0700 1 -- start start 2023-10-14T11:22:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f94a80cc0e0 0x7f94a80d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a80d0460 con 0x7f94a80cc0e0 2023-10-14T11:22:42.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a815bbb0 con 0x7f94a815b7d0 2023-10-14T11:22:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94b03e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80cc520 con 0x7f94a80b6f70 2023-10-14T11:22:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ae17c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ae17c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46502/0 (socket says 172.21.15.72:46502) 2023-10-14T11:22:42.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38170/0 (socket says 172.21.15.72:38170) 2023-10-14T11:22:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ae17c700 1 -- 172.21.15.72:0/4256863863 learned_addr learned my addr 172.21.15.72:0/4256863863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ae97d700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.67:3300/0 conn(0x7f94a80cc0e0 0x7f94a80d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 -- 172.21.15.72:0/4256863863 >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 msgr2=0x7f94a80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 -- 172.21.15.72:0/4256863863 >> v2:172.21.15.67:3300/0 conn(0x7f94a80cc0e0 msgr2=0x7f94a80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.67:3300/0 conn(0x7f94a80cc0e0 0x7f94a80d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 -- 172.21.15.72:0/4256863863 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80cf6a0 con 0x7f94a80b6f70 2023-10-14T11:22:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ae17c700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:42.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad97b700 1 --2- 172.21.15.72:0/4256863863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f94a80cee50 tx=0x7f9498009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c562b69691fb25f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.347+0000 7f94ad17a700 1 -- 172.21.15.72:0/4256863863 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498011830 con 0x7f94a80b6f70 2023-10-14T11:22:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94ad17a700 1 -- 172.21.15.72:0/4256863863 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9498011990 con 0x7f94a80b6f70 2023-10-14T11:22:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94ad17a700 1 -- 172.21.15.72:0/4256863863 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498011d20 con 0x7f94a80b6f70 2023-10-14T11:22:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 -- 172.21.15.72:0/4256863863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 msgr2=0x7f94a80cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 --2- 172.21.15.72:0/4256863863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f94a80cee50 tx=0x7f9498009b20 comp rx=0 tx=0).stop 2023-10-14T11:22:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 -- 172.21.15.72:0/4256863863 shutdown_connections 2023-10-14T11:22:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.67:3300/0 conn(0x7f94a80cc0e0 0x7f94a80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 --2- 172.21.15.72:0/4256863863 >> v2:172.21.15.72:3300/0 conn(0x7f94a815b7d0 0x7f94a80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 --2- 172.21.15.72:0/4256863863 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a80b6f70 0x7f94a80cbba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 -- 172.21.15.72:0/4256863863 >> 172.21.15.72:0/4256863863 conn(0x7f94a80665a0 msgr2=0x7f94a8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.348+0000 7f94b03e0700 1 -- 172.21.15.72:0/4256863863 shutdown_connections 2023-10-14T11:22:42.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.349+0000 7f94b03e0700 1 -- 172.21.15.72:0/4256863863 wait complete. 2023-10-14T11:22:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.350+0000 7f94b03e0700 1 Processor -- start 2023-10-14T11:22:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.350+0000 7f94b03e0700 1 -- start start 2023-10-14T11:22:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 0x7f94a80c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 0x7f94a80a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c9fc0 con 0x7f94a80b6f70 2023-10-14T11:22:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c9030 con 0x7f94a80cc0e0 2023-10-14T11:22:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94b03e0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a80c95f0 con 0x7f94a815b7d0 2023-10-14T11:22:42.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ae97d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 0x7f94a80a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46510/0 (socket says 172.21.15.72:46510) 2023-10-14T11:22:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 -- 172.21.15.72:0/1290281475 learned_addr learned my addr 172.21.15.72:0/1290281475 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ae17c700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 0x7f94a80c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 -- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 msgr2=0x7f94a80a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 0x7f94a80a83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 -- 172.21.15.72:0/1290281475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 msgr2=0x7f94a80c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 0x7f94a80c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 -- 172.21.15.72:0/1290281475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009550 con 0x7f94a80cc0e0 2023-10-14T11:22:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ae17c700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 0x7f94a80c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ae97d700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 0x7f94a80a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f94ad97b700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9498009b60 tx=0x7f9498004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.352+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498004510 con 0x7f94a80cc0e0 2023-10-14T11:22:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949801f070 con 0x7f94a80cc0e0 2023-10-14T11:22:42.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94980038e0 con 0x7f94a80cc0e0 2023-10-14T11:22:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980094a0 con 0x7f94a80cc0e0 2023-10-14T11:22:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a80a95c0 con 0x7f94a80cc0e0 2023-10-14T11:22:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9498003d40 con 0x7f94a80cc0e0 2023-10-14T11:22:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9498021070 con 0x7f94a80cc0e0 2023-10-14T11:22:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.353+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a80c9760 con 0x7f94a80cc0e0 2023-10-14T11:22:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.356+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f9498045b40 con 0x7f94a80cc0e0 2023-10-14T11:22:42.400 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:42.397+0000 7ff87d92e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T11:22:42.403 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:42.402+0000 7f0a955a3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T11:22:42.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.438+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "116cac62-68b9-4079-a39e-c8145c3b4e7a", "id": 4} v 0) v1 -- 0x7f94a804ebb0 con 0x7f94a80cc0e0 2023-10-14T11:22:42.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.444+0000 7f949effd700 1 -- 172.21.15.72:0/1290281475 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "116cac62-68b9-4079-a39e-c8145c3b4e7a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9498034070 con 0x7f94a80cc0e0 2023-10-14T11:22:42.447 INFO:teuthology.orchestra.run.smithi072.stdout:4 2023-10-14T11:22:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 msgr2=0x7f94a81593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9498009b60 tx=0x7f9498004750 comp rx=0 tx=0).stop 2023-10-14T11:22:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 shutdown_connections 2023-10-14T11:22:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94a815b7d0 0x7f94a80a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94a80b6f70 0x7f94a80c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 --2- 172.21.15.72:0/1290281475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94a80cc0e0 0x7f94a81593f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 >> 172.21.15.72:0/1290281475 conn(0x7f94a80665a0 msgr2=0x7f94a80d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 shutdown_connections 2023-10-14T11:22:42.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.445+0000 7f94b03e0700 1 -- 172.21.15.72:0/1290281475 wait complete. 2023-10-14T11:22:42.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 2a0ab0c6-6bff-4c0b-9765-36bfe3dea488 5 2023-10-14T11:22:42.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.581+0000 7fe4cfd7b700 1 Processor -- start 2023-10-14T11:22:42.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 -- start start 2023-10-14T11:22:42.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4c80cf830 0x7fe4c81616f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 0x7fe4c8154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c80cd7d0 con 0x7fe4c815e7e0 2023-10-14T11:22:42.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80ccbb0 con 0x7fe4c80cf830 2023-10-14T11:22:42.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.582+0000 7fe4cfd7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80ce350 con 0x7fe4c8161c30 2023-10-14T11:22:42.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4cdb17700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4c815e7e0 0x7fe4c80cf120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58030/0 (socket says 172.21.15.72:58030) 2023-10-14T11:22:42.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4cdb17700 1 -- 172.21.15.72:0/1798519095 learned_addr learned my addr 172.21.15.72:0/1798519095 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T11:22:42.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 --2- 172.21.15.72:0/1798519095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 0x7fe4c8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4cd316700 1 --2- 172.21.15.72:0/1798519095 >> v2:172.21.15.67:3300/0 conn(0x7fe4c80cf830 0x7fe4c81616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ccb15700 1 -- 172.21.15.72:0/1798519095 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030922426 0 0) 0x7fe4c80cd7d0 con 0x7fe4c815e7e0 2023-10-14T11:22:42.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ccb15700 1 -- 172.21.15.72:0/1798519095 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b40035b0 con 0x7fe4c815e7e0 2023-10-14T11:22:42.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 -- 172.21.15.72:0/1798519095 >> v2:172.21.15.67:3300/0 conn(0x7fe4c80cf830 msgr2=0x7fe4c81616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 --2- 172.21.15.72:0/1798519095 >> v2:172.21.15.67:3300/0 conn(0x7fe4c80cf830 0x7fe4c81616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 -- 172.21.15.72:0/1798519095 >> v1:172.21.15.72:6789/0 conn(0x7fe4c815e7e0 legacy=0x7fe4c80cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 -- 172.21.15.72:0/1798519095 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80cda20 con 0x7fe4c8161c30 2023-10-14T11:22:42.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ce318700 1 --2- 172.21.15.72:0/1798519095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 0x7fe4c8154130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857cf58d87c8b7df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ccb15700 1 -- 172.21.15.72:0/1798519095 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000e070 con 0x7fe4c8161c30 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ccb15700 1 -- 172.21.15.72:0/1798519095 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000bb20 con 0x7fe4c8161c30 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.583+0000 7fe4ccb15700 1 -- 172.21.15.72:0/1798519095 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0012430 con 0x7fe4c8161c30 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1798519095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 msgr2=0x7fe4c8154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1798519095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 0x7fe4c8154130 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009d90 tx=0x7fe4c000b330 comp rx=0 tx=0).stop 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1798519095 shutdown_connections 2023-10-14T11:22:42.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1798519095 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c8161c30 0x7fe4c8154130 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1798519095 >> v2:172.21.15.67:3300/0 conn(0x7fe4c80cf830 0x7fe4c81616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1798519095 >> 172.21.15.72:0/1798519095 conn(0x7fe4c80665a0 msgr2=0x7fe4c8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1798519095 shutdown_connections 2023-10-14T11:22:42.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.584+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1798519095 wait complete. 2023-10-14T11:22:42.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.585+0000 7fe4cfd7b700 1 Processor -- start 2023-10-14T11:22:42.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.585+0000 7fe4cfd7b700 1 -- start start 2023-10-14T11:22:42.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c80cf830 0x7fe4c80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c8161c30 0x7fe4c80c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c9f70 con 0x7fe4c8161c30 2023-10-14T11:22:42.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80b5110 con 0x7fe4c815e7e0 2023-10-14T11:22:42.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cfd7b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80b53f0 con 0x7fe4c80cf830 2023-10-14T11:22:42.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46522/0 (socket says 172.21.15.72:46522) 2023-10-14T11:22:42.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 -- 172.21.15.72:0/1311361441 learned_addr learned my addr 172.21.15.72:0/1311361441 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cdb17700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c80cf830 0x7fe4c80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4ce318700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c8161c30 0x7fe4c80c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 -- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c80cf830 msgr2=0x7fe4c80b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c80cf830 0x7fe4c80b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 -- 172.21.15.72:0/1311361441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c8161c30 msgr2=0x7fe4c80c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c8161c30 0x7fe4c80c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.586+0000 7fe4cd316700 1 -- 172.21.15.72:0/1311361441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0009a70 con 0x7fe4c815e7e0 2023-10-14T11:22:42.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4cd316700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800e8a0 tx=0x7fe4b800ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8009590 con 0x7fe4c815e7e0 2023-10-14T11:22:42.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8013680 con 0x7fe4c815e7e0 2023-10-14T11:22:42.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80139f0 con 0x7fe4c815e7e0 2023-10-14T11:22:42.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c80b56d0 con 0x7fe4c815e7e0 2023-10-14T11:22:42.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80b5c90 con 0x7fe4c815e7e0 2023-10-14T11:22:42.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe4b8005a20 con 0x7fe4c815e7e0 2023-10-14T11:22:42.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.587+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fe4b8006660 con 0x7fe4c815e7e0 2023-10-14T11:22:42.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.588+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c80b5e50 con 0x7fe4c815e7e0 2023-10-14T11:22:42.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.590+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe4b8021060 con 0x7fe4c815e7e0 2023-10-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.671+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a0ab0c6-6bff-4c0b-9765-36bfe3dea488", "id": 5} v 0) v1 -- 0x7fe4c80b6000 con 0x7fe4c815e7e0 2023-10-14T11:22:42.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.676+0000 7fe4be7fc700 1 -- 172.21.15.72:0/1311361441 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a0ab0c6-6bff-4c0b-9765-36bfe3dea488", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe4b8017070 con 0x7fe4c815e7e0 2023-10-14T11:22:42.679 INFO:teuthology.orchestra.run.smithi072.stdout:5 2023-10-14T11:22:42.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 msgr2=0x7fe4c80c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800e8a0 tx=0x7fe4b800ebb0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 shutdown_connections 2023-10-14T11:22:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4c8161c30 0x7fe4c80c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4c80cf830 0x7fe4c80b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 --2- 172.21.15.72:0/1311361441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4c815e7e0 0x7fe4c80c94f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 >> 172.21.15.72:0/1311361441 conn(0x7fe4c80665a0 msgr2=0x7fe4c8157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 shutdown_connections 2023-10-14T11:22:42.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.677+0000 7fe4cfd7b700 1 -- 172.21.15.72:0/1311361441 wait complete. 2023-10-14T11:22:42.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 110976da-bc4a-4dc3-be26-ef2c8a9ceb70 6 2023-10-14T11:22:42.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.835+0000 7fcc62a08700 1 Processor -- start 2023-10-14T11:22:42.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.835+0000 7fcc62a08700 1 -- start start 2023-10-14T11:22:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.836+0000 7fcc62a08700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc5c157280 0x7fcc5c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.836+0000 7fcc62a08700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcc5c0b15d0 0x7fcc5c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.836+0000 7fcc62a08700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c15d4e0 con 0x7fcc5c0ca750 2023-10-14T11:22:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.836+0000 7fcc62a08700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c15e160 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.836+0000 7fcc62a08700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cac00 con 0x7fcc5c157280 2023-10-14T11:22:42.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc5c157280 0x7fcc5c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcc5c157280 0x7fcc5c0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46530/0 (socket says 172.21.15.72:46530) 2023-10-14T11:22:42.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 -- 172.21.15.72:0/348520848 learned_addr learned my addr 172.21.15.72:0/348520848 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 -- 172.21.15.72:0/348520848 >> v2:172.21.15.67:3300/0 conn(0x7fcc5c0b15d0 msgr2=0x7fcc5c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/348520848 >> v2:172.21.15.67:3300/0 conn(0x7fcc5c0b15d0 0x7fcc5c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 -- 172.21.15.72:0/348520848 >> v1:172.21.15.67:6789/0 conn(0x7fcc5c0ca750 legacy=0x7fcc5c0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:42.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 -- 172.21.15.72:0/348520848 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c15d7c0 con 0x7fcc5c157280 2023-10-14T11:22:42.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/348520848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c157280 0x7fcc5c0ca210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b1d10 tx=0x7fcc44009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=251dd68c7f6a937c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.837+0000 7fcc5affd700 1 -- 172.21.15.72:0/348520848 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44004030 con 0x7fcc5c157280 2023-10-14T11:22:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc5affd700 1 -- 172.21.15.72:0/348520848 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc44004190 con 0x7fcc5c157280 2023-10-14T11:22:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc5affd700 1 -- 172.21.15.72:0/348520848 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44004520 con 0x7fcc5c157280 2023-10-14T11:22:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 -- 172.21.15.72:0/348520848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c157280 msgr2=0x7fcc5c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 --2- 172.21.15.72:0/348520848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c157280 0x7fcc5c0ca210 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b1d10 tx=0x7fcc44009520 comp rx=0 tx=0).stop 2023-10-14T11:22:42.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 -- 172.21.15.72:0/348520848 shutdown_connections 2023-10-14T11:22:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 --2- 172.21.15.72:0/348520848 >> v2:172.21.15.67:3300/0 conn(0x7fcc5c0b15d0 0x7fcc5c070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 --2- 172.21.15.72:0/348520848 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c157280 0x7fcc5c0ca210 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 -- 172.21.15.72:0/348520848 >> 172.21.15.72:0/348520848 conn(0x7fcc5c0cbec0 msgr2=0x7fcc5c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 -- 172.21.15.72:0/348520848 shutdown_connections 2023-10-14T11:22:42.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.838+0000 7fcc62a08700 1 -- 172.21.15.72:0/348520848 wait complete. 2023-10-14T11:22:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.840+0000 7fcc62a08700 1 Processor -- start 2023-10-14T11:22:42.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.840+0000 7fcc62a08700 1 -- start start 2023-10-14T11:22:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 0x7fcc5c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 0x7fcc5c14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 0x7fcc5c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c14f0c0 con 0x7fcc5c157280 2023-10-14T11:22:42.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cda30 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.841+0000 7fcc62a08700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cdf60 con 0x7fcc5c0ca750 2023-10-14T11:22:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 0x7fcc5c14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5b7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 0x7fcc5c14e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38198/0 (socket says 172.21.15.72:38198) 2023-10-14T11:22:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5b7fe700 1 -- 172.21.15.72:0/3912408147 learned_addr learned my addr 172.21.15.72:0/3912408147 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:42.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 0x7fcc5c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc60fa5700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 0x7fcc5c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 -- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 msgr2=0x7fcc5c14e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 0x7fcc5c14e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 -- 172.21.15.72:0/3912408147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 msgr2=0x7fcc5c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 0x7fcc5c14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 -- 172.21.15.72:0/3912408147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4400a5f0 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc60fa5700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 0x7fcc5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc5bfff700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 0x7fcc5c0b0210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc4401e000 tx=0x7fcc44004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44027070 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc44019850 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.842+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44019c00 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.843+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0cd470 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.843+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c0ce200 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.844+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c0cddc0 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.844+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc440039a0 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.844+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcc4402ba00 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.847+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcc5c0cddc0 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.938+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "110976da-bc4a-4dc3-be26-ef2c8a9ceb70", "id": 6} v 0) v1 -- 0x7fcc5c04ebb0 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.946+0000 7fcc58ff9700 1 -- 172.21.15.72:0/3912408147 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "110976da-bc4a-4dc3-be26-ef2c8a9ceb70", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc44030070 con 0x7fcc5c0b15d0 2023-10-14T11:22:42.949 INFO:teuthology.orchestra.run.smithi072.stdout:6 2023-10-14T11:22:42.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 msgr2=0x7fcc5c0b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 0x7fcc5c0b0210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcc4401e000 tx=0x7fcc44004750 comp rx=0 tx=0).stop 2023-10-14T11:22:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 shutdown_connections 2023-10-14T11:22:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcc5c157280 0x7fcc5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcc5c0b15d0 0x7fcc5c0b0210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 --2- 172.21.15.72:0/3912408147 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcc5c0ca750 0x7fcc5c14e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 >> 172.21.15.72:0/3912408147 conn(0x7fcc5c0cbec0 msgr2=0x7fcc5c156630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 shutdown_connections 2023-10-14T11:22:42.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:42.947+0000 7fcc62a08700 1 -- 172.21.15.72:0/3912408147 wait complete. 2023-10-14T11:22:42.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd new 0f6ebd80-a866-4045-864f-0817c6f05d84 7 2023-10-14T11:22:43.070 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:43.068+0000 7ff87d92e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T11:22:43.075 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:43.074+0000 7f0a955a3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T11:22:43.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.083+0000 7f6123f86700 1 Processor -- start 2023-10-14T11:22:43.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.083+0000 7f6123f86700 1 -- start start 2023-10-14T11:22:43.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6123f86700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f611c15eb80 0x7f611c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6123f86700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c15e200 con 0x7f611c15de20 2023-10-14T11:22:43.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6123f86700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611c15f040 con 0x7f611c0ce850 2023-10-14T11:22:43.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6123f86700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611c15f320 con 0x7f611c15eb80 2023-10-14T11:22:43.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6121521700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f611c0ce850 0x7f611c15e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58056/0 (socket says 172.21.15.72:58056) 2023-10-14T11:22:43.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6122523700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f611c15eb80 0x7f611c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6121521700 1 -- 172.21.15.72:0/3557626296 learned_addr learned my addr 172.21.15.72:0/3557626296 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-10-14T11:22:43.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6120d20700 1 -- 172.21.15.72:0/3557626296 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441127560 0 0) 0x7f611c15f040 con 0x7f611c0ce850 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6120d20700 1 -- 172.21.15.72:0/3557626296 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61080057c0 con 0x7f611c0ce850 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6122523700 1 -- 172.21.15.72:0/3557626296 >> v1:172.21.15.72:6789/0 conn(0x7f611c0ce850 legacy=0x7f611c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6122523700 1 -- 172.21.15.72:0/3557626296 >> v1:172.21.15.67:6789/0 conn(0x7f611c15de20 legacy=0x7f611c0cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6122523700 1 -- 172.21.15.72:0/3557626296 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0b2320 con 0x7f611c15eb80 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6122523700 1 --2- 172.21.15.72:0/3557626296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c15eb80 0x7f611c06d3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6114009d90 tx=0x7f611400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa5973c6a41e1f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:43.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.084+0000 7f6120d20700 1 -- 172.21.15.72:0/3557626296 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400e070 con 0x7f611c15eb80 2023-10-14T11:22:43.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6120d20700 1 -- 172.21.15.72:0/3557626296 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400bb20 con 0x7f611c15eb80 2023-10-14T11:22:43.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6120d20700 1 -- 172.21.15.72:0/3557626296 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114012430 con 0x7f611c15eb80 2023-10-14T11:22:43.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 -- 172.21.15.72:0/3557626296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c15eb80 msgr2=0x7f611c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 --2- 172.21.15.72:0/3557626296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c15eb80 0x7f611c06d3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6114009d90 tx=0x7f611400b330 comp rx=0 tx=0).stop 2023-10-14T11:22:43.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 -- 172.21.15.72:0/3557626296 shutdown_connections 2023-10-14T11:22:43.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 --2- 172.21.15.72:0/3557626296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c15eb80 0x7f611c06d3b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 -- 172.21.15.72:0/3557626296 >> 172.21.15.72:0/3557626296 conn(0x7f611c0b1760 msgr2=0x7f611c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:43.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 -- 172.21.15.72:0/3557626296 shutdown_connections 2023-10-14T11:22:43.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.085+0000 7f6123f86700 1 -- 172.21.15.72:0/3557626296 wait complete. 2023-10-14T11:22:43.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.086+0000 7f6123f86700 1 Processor -- start 2023-10-14T11:22:43.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.086+0000 7f6123f86700 1 -- start start 2023-10-14T11:22:43.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 0x7f611c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c15eb80 0x7f611c06b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c158030 con 0x7f611c15eb80 2023-10-14T11:22:43.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c09e0c0 con 0x7f611c0ce850 2023-10-14T11:22:43.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6123f86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611c09e3a0 con 0x7f611c15de20 2023-10-14T11:22:43.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6121521700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 0x7f611c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6121d22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6121d22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:46544/0 (socket says 172.21.15.72:46544) 2023-10-14T11:22:43.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6121d22700 1 -- 172.21.15.72:0/2897740120 learned_addr learned my addr 172.21.15.72:0/2897740120 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-10-14T11:22:43.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6122523700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c15eb80 0x7f611c06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.087+0000 7f6121521700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 0x7f611c0c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.72:38212/0 (socket says 172.21.15.72:38212) 2023-10-14T11:22:43.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 -- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 msgr2=0x7f611c0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 0x7f611c0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 -- 172.21.15.72:0/2897740120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c15eb80 msgr2=0x7f611c06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c15eb80 0x7f611c06b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 -- 172.21.15.72:0/2897740120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114009a70 con 0x7f611c0ce850 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6121d22700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f611800c4e0 tx=0x7f611800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180052d0 con 0x7f611c0ce850 2023-10-14T11:22:43.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6118005430 con 0x7f611c0ce850 2023-10-14T11:22:43.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c09e680 con 0x7f611c0ce850 2023-10-14T11:22:43.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180038c0 con 0x7f611c0ce850 2023-10-14T11:22:43.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c09ec40 con 0x7f611c0ce850 2023-10-14T11:22:43.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6118003d20 con 0x7f611c0ce850 2023-10-14T11:22:43.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.088+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6118011d60 con 0x7f611c0ce850 2023-10-14T11:22:43.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.089+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c0cf510 con 0x7f611c0ce850 2023-10-14T11:22:43.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.091+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6118017070 con 0x7f611c0ce850 2023-10-14T11:22:43.142 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:43.140+0000 7ff87d92e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T11:22:43.148 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:43.146+0000 7f0a955a3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T11:22:43.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.174+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0f6ebd80-a866-4045-864f-0817c6f05d84", "id": 7} v 0) v1 -- 0x7f611c04ebb0 con 0x7f611c0ce850 2023-10-14T11:22:43.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.183+0000 7f61127fc700 1 -- 172.21.15.72:0/2897740120 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f6ebd80-a866-4045-864f-0817c6f05d84", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6118011590 con 0x7f611c0ce850 2023-10-14T11:22:43.186 INFO:teuthology.orchestra.run.smithi072.stdout:7 2023-10-14T11:22:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 msgr2=0x7f611c1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f611800c4e0 tx=0x7f611800c7f0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 shutdown_connections 2023-10-14T11:22:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f611c15eb80 0x7f611c06b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f611c0ce850 0x7f611c1574a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 --2- 172.21.15.72:0/2897740120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f611c15de20 0x7f611c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 >> 172.21.15.72:0/2897740120 conn(0x7f611c0b1760 msgr2=0x7f611c071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:43.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 shutdown_connections 2023-10-14T11:22:43.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-10-14T11:22:43.184+0000 7f6123f86700 1 -- 172.21.15.72:0/2897740120 wait complete. 2023-10-14T11:22:43.198 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T11:22:43.199 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T11:22:43.201 INFO:tasks.ceph.osd.0:Started 2023-10-14T11:22:43.201 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T11:22:43.202 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T11:22:43.204 INFO:tasks.ceph.osd.1:Started 2023-10-14T11:22:43.204 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T11:22:43.204 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T11:22:43.206 INFO:tasks.ceph.osd.2:Started 2023-10-14T11:22:43.207 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T11:22:43.207 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T11:22:43.209 INFO:tasks.ceph.osd.3:Started 2023-10-14T11:22:43.209 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T11:22:43.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T11:22:43.212 INFO:tasks.ceph.osd.4:Started 2023-10-14T11:22:43.212 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T11:22:43.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T11:22:43.215 INFO:tasks.ceph.osd.5:Started 2023-10-14T11:22:43.215 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T11:22:43.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T11:22:43.218 INFO:tasks.ceph.osd.6:Started 2023-10-14T11:22:43.218 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T11:22:43.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T11:22:43.221 INFO:tasks.ceph.osd.7:Started 2023-10-14T11:22:43.222 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:43.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.381+0000 7fdf7858d700 1 Processor -- start 2023-10-14T11:22:43.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.381+0000 7fdf7858d700 1 -- start start 2023-10-14T11:22:43.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.382+0000 7fdf7858d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdf7015e4a0 0x7fdf700cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.382+0000 7fdf7858d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 0x7fdf700c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.382+0000 7fdf7858d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700cfa80 con 0x7fdf7015e0c0 2023-10-14T11:22:43.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.382+0000 7fdf7858d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700cfd60 con 0x7fdf7015e4a0 2023-10-14T11:22:43.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.382+0000 7fdf7858d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700d0040 con 0x7fdf700c52c0 2023-10-14T11:22:43.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf76329700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdf7015e0c0 0x7fdf70072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40046/0 (socket says 172.21.15.67:40046) 2023-10-14T11:22:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf76329700 1 -- 172.21.15.67:0/2649279706 learned_addr learned my addr 172.21.15.67:0/2649279706 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf76b2a700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 0x7fdf700c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 --2- 172.21.15.67:0/2649279706 >> v2:172.21.15.72:3300/0 conn(0x7fdf7015e4a0 0x7fdf700cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75327700 1 -- 172.21.15.67:0/2649279706 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142516105 0 0) 0x7fdf700cfa80 con 0x7fdf7015e0c0 2023-10-14T11:22:43.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75327700 1 -- 172.21.15.67:0/2649279706 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf5c0035b0 con 0x7fdf7015e0c0 2023-10-14T11:22:43.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 -- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 msgr2=0x7fdf700c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:43.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 0x7fdf700c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 -- 172.21.15.67:0/2649279706 >> v1:172.21.15.67:6789/0 conn(0x7fdf7015e0c0 legacy=0x7fdf70072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 -- 172.21.15.67:0/2649279706 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7006f570 con 0x7fdf7015e4a0 2023-10-14T11:22:43.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf76b2a700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 0x7fdf700c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:43.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75b28700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf7015e4a0 0x7fdf700cf1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009870 tx=0x7fdf60009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35be814e853d469e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:43.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75327700 1 -- 172.21.15.67:0/2649279706 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60011830 con 0x7fdf7015e4a0 2023-10-14T11:22:43.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75327700 1 -- 172.21.15.67:0/2649279706 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60011990 con 0x7fdf7015e4a0 2023-10-14T11:22:43.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.383+0000 7fdf75327700 1 -- 172.21.15.67:0/2649279706 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60011d20 con 0x7fdf7015e4a0 2023-10-14T11:22:43.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 -- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf7015e4a0 msgr2=0x7fdf700cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf7015e4a0 0x7fdf700cf1c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf60009870 tx=0x7fdf60009b80 comp rx=0 tx=0).stop 2023-10-14T11:22:43.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 -- 172.21.15.67:0/2649279706 shutdown_connections 2023-10-14T11:22:43.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf700c52c0 0x7fdf700c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 --2- 172.21.15.67:0/2649279706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf7015e4a0 0x7fdf700cf1c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 -- 172.21.15.67:0/2649279706 >> 172.21.15.67:0/2649279706 conn(0x7fdf700d0440 msgr2=0x7fdf700d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:43.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 -- 172.21.15.67:0/2649279706 shutdown_connections 2023-10-14T11:22:43.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.384+0000 7fdf7858d700 1 -- 172.21.15.67:0/2649279706 wait complete. 2023-10-14T11:22:43.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.385+0000 7fdf7858d700 1 Processor -- start 2023-10-14T11:22:43.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.385+0000 7fdf7858d700 1 -- start start 2023-10-14T11:22:43.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf700c52c0 0x7fdf701f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf7015e0c0 0x7fdf70159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70070060 con 0x7fdf7015e4a0 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70151f50 con 0x7fdf700c52c0 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf7858d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701f3a30 con 0x7fdf7015e0c0 2023-10-14T11:22:43.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40762/0 (socket says 172.21.15.67:40762) 2023-10-14T11:22:43.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 -- 172.21.15.67:0/1079782855 learned_addr learned my addr 172.21.15.67:0/1079782855 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:43.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76329700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf700c52c0 0x7fdf701f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf75b28700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf7015e0c0 0x7fdf70159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:43.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 -- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf7015e0c0 msgr2=0x7fdf70159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf7015e0c0 0x7fdf70159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 -- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf700c52c0 msgr2=0x7fdf701f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.386+0000 7fdf76b2a700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf700c52c0 0x7fdf701f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf76b2a700 1 -- 172.21.15.67:0/1079782855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68009a70 con 0x7fdf7015e4a0 2023-10-14T11:22:43.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf76b2a700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800efc0 tx=0x7fdf6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:43.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800ca90 con 0x7fdf7015e4a0 2023-10-14T11:22:43.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800f040 con 0x7fdf7015e4a0 2023-10-14T11:22:43.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800ce10 con 0x7fdf7015e4a0 2023-10-14T11:22:43.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600094a0 con 0x7fdf7015e4a0 2023-10-14T11:22:43.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.387+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70154010 con 0x7fdf7015e4a0 2023-10-14T11:22:43.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.388+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdf68003d20 con 0x7fdf7015e4a0 2023-10-14T11:22:43.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.388+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fdf68014b50 con 0x7fdf7015e4a0 2023-10-14T11:22:43.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.388+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf701520e0 con 0x7fdf7015e4a0 2023-10-14T11:22:43.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.390+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fdf68018030 con 0x7fdf7015e4a0 2023-10-14T11:22:43.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.461+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf7004ebb0 con 0x7fdf7015e4a0 2023-10-14T11:22:43.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.462+0000 7fdf66ffd700 1 -- 172.21.15.67:0/1079782855 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdf68014480 con 0x7fdf7015e4a0 2023-10-14T11:22:43.464 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:43.465 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:43.177082+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 msgr2=0x7fdf700c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800efc0 tx=0x7fdf6800c3a0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 shutdown_connections 2023-10-14T11:22:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdf7015e4a0 0x7fdf700c6880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdf700c52c0 0x7fdf701f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 --2- 172.21.15.67:0/1079782855 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdf7015e0c0 0x7fdf70159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:43.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 >> 172.21.15.67:0/1079782855 conn(0x7fdf700d0440 msgr2=0x7fdf700cb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:43.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 shutdown_connections 2023-10-14T11:22:43.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:43.463+0000 7fdf7858d700 1 -- 172.21.15.67:0/1079782855 wait complete. 2023-10-14T11:22:43.477 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T11:22:43.478 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T11:22:43.577 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-14T11:22:43.574+0000 7f4ae84d2640 -1 Falling back to public interface 2023-10-14T11:22:43.828 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-14T11:22:43.825+0000 7f524fd24640 -1 Falling back to public interface 2023-10-14T11:22:43.829 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-14T11:22:43.826+0000 7f75a5a24640 -1 Falling back to public interface 2023-10-14T11:22:43.832 INFO:tasks.ceph.osd.3.smithi067.stderr:2023-10-14T11:22:43.830+0000 7ff34c3d8640 -1 Falling back to public interface 2023-10-14T11:22:43.835 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-14T11:22:43.832+0000 7ffbad9d9640 -1 Falling back to public interface 2023-10-14T11:22:43.838 INFO:tasks.ceph.osd.0.smithi067.stderr:2023-10-14T11:22:43.836+0000 7f1635aa0640 -1 Falling back to public interface 2023-10-14T11:22:43.841 INFO:tasks.ceph.osd.1.smithi067.stderr:2023-10-14T11:22:43.839+0000 7fd8c9979640 -1 Falling back to public interface 2023-10-14T11:22:43.843 INFO:tasks.ceph.osd.2.smithi067.stderr:2023-10-14T11:22:43.841+0000 7fe59a530640 -1 Falling back to public interface 2023-10-14T11:22:43.879 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:43.876+0000 7ff87d92e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:22:43.922 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:43.921+0000 7f0a955a3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:22:43.955 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:43.952+0000 7ff87d92e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T11:22:44.004 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.002+0000 7f0a955a3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T11:22:44.096 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:44.093+0000 7ff87d92e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:22:44.151 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.150+0000 7f0a955a3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T11:22:44.283 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:44.333 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:44.330+0000 7ff87d92e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T11:22:44.399 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.397+0000 7f700f114700 1 Processor -- start 2023-10-14T11:22:44.399 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.397+0000 7f700f114700 1 -- start start 2023-10-14T11:22:44.401 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.398+0000 7f700f114700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f700815d990 0x7f70080d3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:44.402 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.398+0000 7f700f114700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70080cf1f0 0x7f7008162030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:44.402 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.398+0000 7f700f114700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70080ce200 con 0x7f70080d1ab0 2023-10-14T11:22:44.402 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.398+0000 7f700f114700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7008162570 con 0x7f70080cf1f0 2023-10-14T11:22:44.402 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.398+0000 7f700f114700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080ced60 con 0x7f700815d990 2023-10-14T11:22:44.403 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70080cf1f0 0x7f7008162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:44.403 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f700d6b1700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f70080d1ab0 0x7f700806b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40062/0 (socket says 172.21.15.67:40062) 2023-10-14T11:22:44.403 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f700d6b1700 1 -- 172.21.15.67:0/1263850147 learned_addr learned my addr 172.21.15.67:0/1263850147 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:44.403 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f700ceb0700 1 --2- 172.21.15.67:0/1263850147 >> v2:172.21.15.72:3300/0 conn(0x7f700815d990 0x7f70080d3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:44.403 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 -- 172.21.15.67:0/1263850147 >> v2:172.21.15.72:3300/0 conn(0x7f700815d990 msgr2=0x7f70080d3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:44.404 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 --2- 172.21.15.67:0/1263850147 >> v2:172.21.15.72:3300/0 conn(0x7f700815d990 0x7f70080d3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.404 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 -- 172.21.15.67:0/1263850147 >> v1:172.21.15.67:6789/0 conn(0x7f70080d1ab0 legacy=0x7f700806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:44.404 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f70077fe700 1 -- 172.21.15.67:0/1263850147 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423435418 0 0) 0x7f70080ce200 con 0x7f70080d1ab0 2023-10-14T11:22:44.404 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 -- 172.21.15.67:0/1263850147 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080d4560 con 0x7f70080cf1f0 2023-10-14T11:22:44.405 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f7007fff700 1 --2- 172.21.15.67:0/1263850147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70080cf1f0 0x7f7008162030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009840 tx=0x7f6ff4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1378176814ec8e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:44.405 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f70077fe700 1 -- 172.21.15.67:0/1263850147 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4011830 con 0x7f70080cf1f0 2023-10-14T11:22:44.405 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f70077fe700 1 -- 172.21.15.67:0/1263850147 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff4011990 con 0x7f70080cf1f0 2023-10-14T11:22:44.405 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.399+0000 7f70077fe700 1 -- 172.21.15.67:0/1263850147 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4011d20 con 0x7f70080cf1f0 2023-10-14T11:22:44.406 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f0a955a3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T11:22:44.409 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 -- 172.21.15.67:0/1263850147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70080cf1f0 msgr2=0x7f7008162030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:44.409 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 --2- 172.21.15.67:0/1263850147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70080cf1f0 0x7f7008162030 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009840 tx=0x7f6ff4009b50 comp rx=0 tx=0).stop 2023-10-14T11:22:44.409 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 -- 172.21.15.67:0/1263850147 shutdown_connections 2023-10-14T11:22:44.409 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 --2- 172.21.15.67:0/1263850147 >> v2:172.21.15.72:3300/0 conn(0x7f700815d990 0x7f70080d3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.410 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 --2- 172.21.15.67:0/1263850147 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70080cf1f0 0x7f7008162030 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.410 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 -- 172.21.15.67:0/1263850147 >> 172.21.15.67:0/1263850147 conn(0x7f700809c960 msgr2=0x7f70080d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:44.410 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 -- 172.21.15.67:0/1263850147 shutdown_connections 2023-10-14T11:22:44.410 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.400+0000 7f700f114700 1 -- 172.21.15.67:0/1263850147 wait complete. 2023-10-14T11:22:44.410 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.402+0000 7f700f114700 1 Processor -- start 2023-10-14T11:22:44.411 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.402+0000 7f700f114700 1 -- start start 2023-10-14T11:22:44.411 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70080cf1f0 0x7f700815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:44.411 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70080d1ab0 0x7f70080cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:44.411 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:44.411 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080b6690 con 0x7f700815d990 2023-10-14T11:22:44.412 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080cae20 con 0x7f70080d1ab0 2023-10-14T11:22:44.412 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700f114700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080ca860 con 0x7f70080cf1f0 2023-10-14T11:22:44.412 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:44.412 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40774/0 (socket says 172.21.15.67:40774) 2023-10-14T11:22:44.412 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 -- 172.21.15.67:0/4191245125 learned_addr learned my addr 172.21.15.67:0/4191245125 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:44.413 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f7007fff700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70080d1ab0 0x7f70080cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:44.413 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700ceb0700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70080cf1f0 0x7f700815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:44.413 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 -- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70080cf1f0 msgr2=0x7f700815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:44.413 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70080cf1f0 0x7f700815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.413 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 -- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70080d1ab0 msgr2=0x7f70080cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:44.414 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70080d1ab0 0x7f70080cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.414 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 -- 172.21.15.67:0/4191245125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40094a0 con 0x7f700815d990 2023-10-14T11:22:44.414 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.403+0000 7f700d6b1700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7000002230 tx=0x7f700000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:44.414 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000aac0 con 0x7f700815d990 2023-10-14T11:22:44.414 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000ac40 con 0x7f700815d990 2023-10-14T11:22:44.415 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70080cab40 con 0x7f700815d990 2023-10-14T11:22:44.415 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000070d0 con 0x7f700815d990 2023-10-14T11:22:44.415 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70080cb5a0 con 0x7f700815d990 2023-10-14T11:22:44.415 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7000007550 con 0x7f700815d990 2023-10-14T11:22:44.415 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.404+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f700001d440 con 0x7f700815d990 2023-10-14T11:22:44.416 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.405+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700804ebb0 con 0x7f700815d990 2023-10-14T11:22:44.416 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.407+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7000018070 con 0x7f700815d990 2023-10-14T11:22:44.480 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.478+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70080b67d0 con 0x7f700815d990 2023-10-14T11:22:44.480 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.478+0000 7f70057fa700 1 -- 172.21.15.67:0/4191245125 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7000007800 con 0x7f700815d990 2023-10-14T11:22:44.481 INFO:teuthology.misc.health.smithi067.stdout: 2023-10-14T11:22:44.481 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:43.177082+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:44.482 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 msgr2=0x7f700815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:44.482 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7000002230 tx=0x7f700000cf50 comp rx=0 tx=0).stop 2023-10-14T11:22:44.483 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 shutdown_connections 2023-10-14T11:22:44.483 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f700815d990 0x7f700815c710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.483 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70080cf1f0 0x7f700815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.483 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 --2- 172.21.15.67:0/4191245125 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70080d1ab0 0x7f70080cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:44.483 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 >> 172.21.15.67:0/4191245125 conn(0x7f700809c960 msgr2=0x7f70080d1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:44.484 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.479+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 shutdown_connections 2023-10-14T11:22:44.484 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:44.480+0000 7f700f114700 1 -- 172.21.15.67:0/4191245125 wait complete. 2023-10-14T11:22:44.493 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T11:22:44.544 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:44.541+0000 7ff87d92e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T11:22:44.622 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.621+0000 7f0a955a3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T11:22:44.677 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:44.674+0000 7ff87d92e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T11:22:44.763 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.761+0000 7f0a955a3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T11:22:44.894 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:44.891+0000 7ff87d92e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T11:22:44.992 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:44.990+0000 7f0a955a3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T11:22:45.049 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:45.047+0000 7ff87d92e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T11:22:45.155 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:45.153+0000 7f0a955a3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T11:22:45.162 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:45.159+0000 7ff87d92e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T11:22:45.277 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:45.274+0000 7f0a955a3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T11:22:45.483 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:45.480+0000 7ff87d92e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T11:22:45.583 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:45.580+0000 7ff87d92e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T11:22:45.610 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:45.608+0000 7f0a955a3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T11:22:45.713 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:45.711+0000 7f0a955a3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T11:22:45.770 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:45.767+0000 7ff87d92e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T11:22:45.908 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:45.906+0000 7f0a955a3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T11:22:46.376 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:46.374+0000 7ff87d92e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T11:22:46.545 INFO:tasks.ceph.mgr.y.smithi067.stderr:2023-10-14T11:22:46.543+0000 7f0a955a3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T11:22:47.115 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-14T11:22:47.112+0000 7f4ae84d2640 -1 osd.4 0 log_to_monitors true 2023-10-14T11:22:47.122 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-14T11:22:47.119+0000 7f75a5a24640 -1 osd.6 0 log_to_monitors true 2023-10-14T11:22:47.369 INFO:tasks.ceph.osd.1.smithi067.stderr:2023-10-14T11:22:47.367+0000 7fd8c9979640 -1 osd.1 0 log_to_monitors true 2023-10-14T11:22:47.371 INFO:tasks.ceph.osd.2.smithi067.stderr:2023-10-14T11:22:47.368+0000 7fe59a530640 -1 osd.2 0 log_to_monitors true 2023-10-14T11:22:47.383 INFO:tasks.ceph.osd.3.smithi067.stderr:2023-10-14T11:22:47.381+0000 7ff34c3d8640 -1 osd.3 0 log_to_monitors true 2023-10-14T11:22:47.385 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-14T11:22:47.383+0000 7f524fd24640 -1 osd.7 0 log_to_monitors true 2023-10-14T11:22:47.392 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-14T11:22:47.390+0000 7ffbad9d9640 -1 osd.5 0 log_to_monitors true 2023-10-14T11:22:47.400 INFO:tasks.ceph.osd.0.smithi067.stderr:2023-10-14T11:22:47.398+0000 7f1635aa0640 -1 osd.0 0 log_to_monitors true 2023-10-14T11:22:47.402 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:47.400+0000 7ff8358bc700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T11:22:47.403 INFO:tasks.ceph.mgr.x.smithi072.stderr:2023-10-14T11:22:47.400+0000 7ff8358bc700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T11:22:50.404 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-14T11:22:50.401+0000 7f4adc089700 -1 osd.4 0 waiting for initial osdmap 2023-10-14T11:22:50.415 INFO:tasks.ceph.osd.4.smithi072.stderr:2023-10-14T11:22:50.412+0000 7f4ad4464700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.482 INFO:tasks.ceph.osd.3.smithi067.stderr:2023-10-14T11:22:50.479+0000 7ff33ff8f700 -1 osd.3 0 waiting for initial osdmap 2023-10-14T11:22:50.495 INFO:tasks.ceph.osd.3.smithi067.stderr:2023-10-14T11:22:50.493+0000 7ff33836a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.496 INFO:tasks.ceph.osd.1.smithi067.stderr:2023-10-14T11:22:50.494+0000 7fd8bd530700 -1 osd.1 0 waiting for initial osdmap 2023-10-14T11:22:50.497 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-14T11:22:50.495+0000 7ffba1590700 -1 osd.5 0 waiting for initial osdmap 2023-10-14T11:22:50.509 INFO:tasks.ceph.osd.1.smithi067.stderr:2023-10-14T11:22:50.507+0000 7fd8b590b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.510 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-14T11:22:50.507+0000 7f52438db700 -1 osd.7 0 waiting for initial osdmap 2023-10-14T11:22:50.513 INFO:tasks.ceph.osd.5.smithi072.stderr:2023-10-14T11:22:50.510+0000 7ffb9996b700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.522 INFO:tasks.ceph.osd.7.smithi072.stderr:2023-10-14T11:22:50.520+0000 7f523bcb6700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.526 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-14T11:22:50.524+0000 7f75995db700 -1 osd.6 0 waiting for initial osdmap 2023-10-14T11:22:50.538 INFO:tasks.ceph.osd.2.smithi067.stderr:2023-10-14T11:22:50.536+0000 7fe58e0e7700 -1 osd.2 0 waiting for initial osdmap 2023-10-14T11:22:50.544 INFO:tasks.ceph.osd.6.smithi072.stderr:2023-10-14T11:22:50.542+0000 7f75919b6700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.559 INFO:tasks.ceph.osd.2.smithi067.stderr:2023-10-14T11:22:50.557+0000 7fe5864c2700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:50.586 INFO:tasks.ceph.osd.0.smithi067.stderr:2023-10-14T11:22:50.584+0000 7f1629657700 -1 osd.0 0 waiting for initial osdmap 2023-10-14T11:22:50.605 INFO:tasks.ceph.osd.0.smithi067.stderr:2023-10-14T11:22:50.603+0000 7f1621a32700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T11:22:51.299 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:51.432 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.430+0000 7f542fe5e700 1 Processor -- start 2023-10-14T11:22:51.433 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.430+0000 7f542fe5e700 1 -- start start 2023-10-14T11:22:51.435 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542fe5e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f542815daa0 0x7f54280d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.435 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542fe5e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54280d3340 0x7f54280d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.435 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542fe5e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542815eed0 con 0x7f54280d4030 2023-10-14T11:22:51.435 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542fe5e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280d3cf0 con 0x7f54280d3340 2023-10-14T11:22:51.435 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542fe5e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542815e910 con 0x7f542815daa0 2023-10-14T11:22:51.436 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542e3fb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54280d3340 0x7f54280d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.437 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542d3f9700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f54280d4030 0x7f542815de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40230/0 (socket says 172.21.15.67:40230) 2023-10-14T11:22:51.437 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542e3fb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f54280d3340 0x7f54280d37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40940/0 (socket says 172.21.15.67:40940) 2023-10-14T11:22:51.437 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.431+0000 7f542d3f9700 1 -- 172.21.15.67:0/915778925 learned_addr learned my addr 172.21.15.67:0/915778925 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:51.437 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542dbfa700 1 --2- 172.21.15.67:0/915778925 >> v2:172.21.15.72:3300/0 conn(0x7f542815daa0 0x7f54280d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.438 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542e3fb700 1 -- 172.21.15.67:0/915778925 >> v2:172.21.15.72:3300/0 conn(0x7f542815daa0 msgr2=0x7f54280d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:51.438 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542e3fb700 1 --2- 172.21.15.67:0/915778925 >> v2:172.21.15.72:3300/0 conn(0x7f542815daa0 0x7f54280d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.438 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542e3fb700 1 -- 172.21.15.67:0/915778925 >> v1:172.21.15.67:6789/0 conn(0x7f54280d4030 legacy=0x7f542815de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.438 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542e3fb700 1 -- 172.21.15.67:0/915778925 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542815ebf0 con 0x7f54280d3340 2023-10-14T11:22:51.439 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542cbf8700 1 -- 172.21.15.67:0/915778925 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429697978 0 0) 0x7f542815eed0 con 0x7f54280d4030 2023-10-14T11:22:51.439 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542e3fb700 1 --2- 172.21.15.67:0/915778925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280d3340 0x7f54280d37b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f542808cd80 tx=0x7f5420009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5801ffe9f68a1883 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.439 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542cbf8700 1 -- 172.21.15.67:0/915778925 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420011830 con 0x7f54280d3340 2023-10-14T11:22:51.439 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542cbf8700 1 -- 172.21.15.67:0/915778925 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5420011990 con 0x7f54280d3340 2023-10-14T11:22:51.439 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.432+0000 7f542cbf8700 1 -- 172.21.15.67:0/915778925 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420011d20 con 0x7f54280d3340 2023-10-14T11:22:51.440 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 -- 172.21.15.67:0/915778925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280d3340 msgr2=0x7f54280d37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.440 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 --2- 172.21.15.67:0/915778925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280d3340 0x7f54280d37b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f542808cd80 tx=0x7f5420009b20 comp rx=0 tx=0).stop 2023-10-14T11:22:51.440 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 -- 172.21.15.67:0/915778925 shutdown_connections 2023-10-14T11:22:51.440 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 --2- 172.21.15.67:0/915778925 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280d3340 0x7f54280d37b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.441 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 --2- 172.21.15.67:0/915778925 >> v2:172.21.15.72:3300/0 conn(0x7f542815daa0 0x7f54280d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.441 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 -- 172.21.15.67:0/915778925 >> 172.21.15.67:0/915778925 conn(0x7f542806b020 msgr2=0x7f542809c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:51.441 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 -- 172.21.15.67:0/915778925 shutdown_connections 2023-10-14T11:22:51.442 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.433+0000 7f542fe5e700 1 -- 172.21.15.67:0/915778925 wait complete. 2023-10-14T11:22:51.447 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.434+0000 7f542fe5e700 1 Processor -- start 2023-10-14T11:22:51.447 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.434+0000 7f542fe5e700 1 -- start start 2023-10-14T11:22:51.448 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54280d3340 0x7f54280c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.448 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815daa0 0x7f5428152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.448 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.449 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280cce00 con 0x7f54280cb9e0 2023-10-14T11:22:51.449 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542815a450 con 0x7f542815daa0 2023-10-14T11:22:51.449 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542fe5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280cc560 con 0x7f54280d3340 2023-10-14T11:22:51.450 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.450 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40946/0 (socket says 172.21.15.67:40946) 2023-10-14T11:22:51.450 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 -- 172.21.15.67:0/847845696 learned_addr learned my addr 172.21.15.67:0/847845696 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:51.450 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542d3f9700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815daa0 0x7f5428152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.451 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542dbfa700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54280d3340 0x7f54280c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.451 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 -- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54280d3340 msgr2=0x7f54280c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.451 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54280d3340 0x7f54280c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.451 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 -- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815daa0 msgr2=0x7f5428152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.451 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815daa0 0x7f5428152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.452 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 -- 172.21.15.67:0/847845696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54200094a0 con 0x7f54280cb9e0 2023-10-14T11:22:51.452 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.435+0000 7f542e3fb700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f542808cdb0 tx=0x7f5420004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.452 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.436+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200036a0 con 0x7f54280cb9e0 2023-10-14T11:22:51.452 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.436+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542001f070 con 0x7f54280cb9e0 2023-10-14T11:22:51.452 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.436+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280cc840 con 0x7f54280cb9e0 2023-10-14T11:22:51.453 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.436+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5420003a60 con 0x7f54280cb9e0 2023-10-14T11:22:51.453 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.436+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542815c180 con 0x7f54280cb9e0 2023-10-14T11:22:51.453 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.437+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542815a5c0 con 0x7f54280cb9e0 2023-10-14T11:22:51.453 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.437+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5420003bc0 con 0x7f54280cb9e0 2023-10-14T11:22:51.453 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.438+0000 7f54267fc700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 0x7f541406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.454 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.438+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f5420021070 con 0x7f54280cb9e0 2023-10-14T11:22:51.454 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.438+0000 7f542dbfa700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 0x7f541406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.454 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.438+0000 7f542dbfa700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 0x7f541406d360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5418003b30 tx=0x7f5418009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.454 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.442+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5420055e60 con 0x7f54280cb9e0 2023-10-14T11:22:51.647 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.645+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5428067cf0 con 0x7f54280cb9e0 2023-10-14T11:22:51.648 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.646+0000 7f54267fc700 1 -- 172.21.15.67:0/847845696 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7f5420015090 con 0x7f54280cb9e0 2023-10-14T11:22:51.648 INFO:teuthology.misc.health.smithi067.stdout: 2023-10-14T11:22:51.648 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":13,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:51.404950+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:51.650 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 msgr2=0x7f541406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.651 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 0x7f541406d360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5418003b30 tx=0x7f5418009830 comp rx=0 tx=0).stop 2023-10-14T11:22:51.651 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 msgr2=0x7f54280cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.651 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f542808cdb0 tx=0x7f5420004750 comp rx=0 tx=0).stop 2023-10-14T11:22:51.651 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 shutdown_connections 2023-10-14T11:22:51.651 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f541406aea0 0x7f541406d360 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f54280cb9e0 0x7f54280cbe70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f54280d3340 0x7f54280c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 --2- 172.21.15.67:0/847845696 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f542815daa0 0x7f5428152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 >> 172.21.15.67:0/847845696 conn(0x7f542806b020 msgr2=0x7f542806d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 shutdown_connections 2023-10-14T11:22:51.652 INFO:teuthology.misc.health.smithi067.stderr:2023-10-14T11:22:51.648+0000 7f542fe5e700 1 -- 172.21.15.67:0/847845696 wait complete. 2023-10-14T11:22:51.661 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T11:22:51.662 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T11:22:51.662 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T11:22:51.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T11:22:51.666 INFO:tasks.ceph.mds.a:Started 2023-10-14T11:22:51.666 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T11:22:51.666 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T11:22:51.668 INFO:tasks.ceph.mds.c:Started 2023-10-14T11:22:51.668 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T11:22:51.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T11:22:51.671 INFO:tasks.ceph.mds.b:Started 2023-10-14T11:22:51.672 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T11:22:51.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T11:22:51.674 INFO:tasks.ceph.mds.d:Started 2023-10-14T11:22:51.675 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T11:22:51.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:51.749 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2023-10-14T11:22:51.750 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2023-10-14T11:22:51.762 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-14T11:22:51.763 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-14T11:22:51.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.806+0000 7ff2ee511700 1 Processor -- start 2023-10-14T11:22:51.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.806+0000 7ff2ee511700 1 -- start start 2023-10-14T11:22:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ee511700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ee511700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e80cfa80 con 0x7ff2e80c52c0 2023-10-14T11:22:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ee511700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e80cfd60 con 0x7ff2e815e0c0 2023-10-14T11:22:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ee511700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80d0040 con 0x7ff2e815e4a0 2023-10-14T11:22:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ecaae700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2e80c52c0 0x7ff2e806fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40290/0 (socket says 172.21.15.67:40290) 2023-10-14T11:22:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40992/0 (socket says 172.21.15.67:40992) 2023-10-14T11:22:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2ecaae700 1 -- 172.21.15.67:0/3210088280 learned_addr learned my addr 172.21.15.67:0/3210088280 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 -- 172.21.15.67:0/3210088280 >> v1:172.21.15.72:6789/0 conn(0x7ff2e815e0c0 legacy=0x7ff2e8072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 -- 172.21.15.67:0/3210088280 >> v1:172.21.15.67:6789/0 conn(0x7ff2e80c52c0 legacy=0x7ff2e806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 -- 172.21.15.67:0/3210088280 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e806f570 con 0x7ff2e815e4a0 2023-10-14T11:22:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.807+0000 7ff2e77fe700 1 --2- 172.21.15.67:0/3210088280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009870 tx=0x7ff2d8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489aed17c41ce05d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2e6ffd700 1 -- 172.21.15.67:0/3210088280 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011830 con 0x7ff2e815e4a0 2023-10-14T11:22:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2e6ffd700 1 -- 172.21.15.67:0/3210088280 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8011990 con 0x7ff2e815e4a0 2023-10-14T11:22:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2e6ffd700 1 -- 172.21.15.67:0/3210088280 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011d20 con 0x7ff2e815e4a0 2023-10-14T11:22:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 -- 172.21.15.67:0/3210088280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e815e4a0 msgr2=0x7ff2e80cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 --2- 172.21.15.67:0/3210088280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009870 tx=0x7ff2d8009b80 comp rx=0 tx=0).stop 2023-10-14T11:22:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 -- 172.21.15.67:0/3210088280 shutdown_connections 2023-10-14T11:22:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 --2- 172.21.15.67:0/3210088280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e815e4a0 0x7ff2e80cf1c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 -- 172.21.15.67:0/3210088280 >> 172.21.15.67:0/3210088280 conn(0x7ff2e80d0440 msgr2=0x7ff2e80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 -- 172.21.15.67:0/3210088280 shutdown_connections 2023-10-14T11:22:51.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.808+0000 7ff2ee511700 1 -- 172.21.15.67:0/3210088280 wait complete. 2023-10-14T11:22:51.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.809+0000 7ff2ee511700 1 Processor -- start 2023-10-14T11:22:51.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 -- start start 2023-10-14T11:22:51.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e815e0c0 0x7ff2e8157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e815e4a0 0x7ff2e81f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8155150 con 0x7ff2e80c52c0 2023-10-14T11:22:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8155430 con 0x7ff2e815e4a0 2023-10-14T11:22:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2ee511700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8155710 con 0x7ff2e815e0c0 2023-10-14T11:22:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:40998/0 (socket says 172.21.15.67:40998) 2023-10-14T11:22:51.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.810+0000 7ff2e7fff700 1 -- 172.21.15.67:0/1085393058 learned_addr learned my addr 172.21.15.67:0/1085393058 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e77fe700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e815e0c0 0x7ff2e8157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2ecaae700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e815e4a0 0x7ff2e81f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 -- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e815e0c0 msgr2=0x7ff2e8157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e815e0c0 0x7ff2e8157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 -- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e815e4a0 msgr2=0x7ff2e81f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e815e4a0 0x7ff2e81f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 -- 172.21.15.67:0/1085393058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094a0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e7fff700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e940 tx=0x7ff2d000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00052d0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0005430 con 0x7ff2e80c52c0 2023-10-14T11:22:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e81559f0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00108e0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.811+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8155fb0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.812+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e804ebb0 con 0x7ff2e80c52c0 2023-10-14T11:22:51.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.813+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff2d0010a40 con 0x7ff2e80c52c0 2023-10-14T11:22:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.813+0000 7ff2e4ff9700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 0x7ff2c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.813+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7ff2d008af80 con 0x7ff2e80c52c0 2023-10-14T11:22:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.813+0000 7ff2e77fe700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 0x7ff2c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:51.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.813+0000 7ff2e77fe700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 0x7ff2c806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:51.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:51.817+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2d00565e0 con 0x7ff2e80c52c0 2023-10-14T11:22:52.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.020+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2e8072cc0 con 0x7ff2e80c52c0 2023-10-14T11:22:52.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.020+0000 7ff2e4ff9700 1 -- 172.21.15.67:0/1085393058 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7ff2d001f090 con 0x7ff2e80c52c0 2023-10-14T11:22:52.023 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:52.023 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":13,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:51.404950+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:52.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 msgr2=0x7ff2c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 0x7ff2c806d330 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d8008030 comp rx=0 tx=0).stop 2023-10-14T11:22:52.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 msgr2=0x7ff2e80b5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e940 tx=0x7ff2d000ec50 comp rx=0 tx=0).stop 2023-10-14T11:22:52.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 shutdown_connections 2023-10-14T11:22:52.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2e815e4a0 0x7ff2e81f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2c806ae70 0x7ff2c806d330 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2e80c52c0 0x7ff2e80b5490 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 --2- 172.21.15.67:0/1085393058 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2e815e0c0 0x7ff2e8157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 >> 172.21.15.67:0/1085393058 conn(0x7ff2e80d0440 msgr2=0x7ff2e80c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:52.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 shutdown_connections 2023-10-14T11:22:52.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.023+0000 7ff2ee511700 1 -- 172.21.15.67:0/1085393058 wait complete. 2023-10-14T11:22:52.037 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T11:22:52.038 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:22:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.162+0000 7f4263188700 1 Processor -- start 2023-10-14T11:22:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.162+0000 7f4263188700 1 -- start start 2023-10-14T11:22:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4263188700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4263188700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c15f030 con 0x7f425c15dc70 2023-10-14T11:22:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4263188700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c06d2a0 con 0x7f425c15d890 2023-10-14T11:22:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4263188700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c06e340 con 0x7f425c0cde50 2023-10-14T11:22:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4261725700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f425c15dc70 0x7f425c0cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40336/0 (socket says 172.21.15.67:40336) 2023-10-14T11:22:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f4261725700 1 -- 172.21.15.67:0/797560708 learned_addr learned my addr 172.21.15.67:0/797560708 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425bfff700 1 --2- 172.21.15.67:0/797560708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422403847 0 0) 0x7f4254001490 con 0x7f425c15dc70 2023-10-14T11:22:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f424c0035b0 con 0x7f425c15dc70 2023-10-14T11:22:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028980777 0 0) 0x7f425c06d2a0 con 0x7f425c15d890 2023-10-14T11:22:52.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425bfff700 1 -- 172.21.15.67:0/797560708 >> v1:172.21.15.72:6789/0 conn(0x7f425c15d890 legacy=0x7f425c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425bfff700 1 -- 172.21.15.67:0/797560708 >> v1:172.21.15.67:6789/0 conn(0x7f425c15dc70 legacy=0x7f425c0cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425bfff700 1 -- 172.21.15.67:0/797560708 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c06d580 con 0x7f425c0cde50 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425bfff700 1 --2- 172.21.15.67:0/797560708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15eaf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f4248009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26a2237623044d09 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248011830 con 0x7f425c0cde50 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.163+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4248011990 con 0x7f425c0cde50 2023-10-14T11:22:52.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f425b7fe700 1 -- 172.21.15.67:0/797560708 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248011d20 con 0x7f425c0cde50 2023-10-14T11:22:52.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 -- 172.21.15.67:0/797560708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 msgr2=0x7f425c15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 --2- 172.21.15.67:0/797560708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15eaf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4248009870 tx=0x7f4248009b80 comp rx=0 tx=0).stop 2023-10-14T11:22:52.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 -- 172.21.15.67:0/797560708 shutdown_connections 2023-10-14T11:22:52.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 --2- 172.21.15.67:0/797560708 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15eaf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 -- 172.21.15.67:0/797560708 >> 172.21.15.67:0/797560708 conn(0x7f425c0b16f0 msgr2=0x7f425c0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:52.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 -- 172.21.15.67:0/797560708 shutdown_connections 2023-10-14T11:22:52.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.164+0000 7f4263188700 1 -- 172.21.15.67:0/797560708 wait complete. 2023-10-14T11:22:52.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.165+0000 7f4263188700 1 Processor -- start 2023-10-14T11:22:52.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.165+0000 7f4263188700 1 -- start start 2023-10-14T11:22:52.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:52.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:52.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f425c15dc70 0x7f425c1f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:52.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c15bd70 con 0x7f425c15d890 2023-10-14T11:22:52.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c0ca830 con 0x7f425c15dc70 2023-10-14T11:22:52.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4263188700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c1e4ef0 con 0x7f425c0cde50 2023-10-14T11:22:52.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f425bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:52.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f425bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41046/0 (socket says 172.21.15.67:41046) 2023-10-14T11:22:52.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f425bfff700 1 -- 172.21.15.67:0/4209953164 learned_addr learned my addr 172.21.15.67:0/4209953164 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:52.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4260f24700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:52.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.166+0000 7f4261725700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f425c15dc70 0x7f425c1f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:52.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 -- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 msgr2=0x7f425c15b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 -- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f425c15dc70 msgr2=0x7f425c1f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f425c15dc70 0x7f425c1f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 -- 172.21.15.67:0/4209953164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480094a0 con 0x7f425c15d890 2023-10-14T11:22:52.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f425bfff700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4248014040 tx=0x7f4248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:52.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424801a7e0 con 0x7f425c15d890 2023-10-14T11:22:52.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424801a940 con 0x7f425c15d890 2023-10-14T11:22:52.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c1e51d0 con 0x7f425c15d890 2023-10-14T11:22:52.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424801acd0 con 0x7f425c15d890 2023-10-14T11:22:52.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.167+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c0ca450 con 0x7f425c15d890 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.168+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c06d840 con 0x7f425c15d890 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.168+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f4248022070 con 0x7f425c15d890 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.169+0000 7f42597fa700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 0x7f424006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.169+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4248089f00 con 0x7f425c15d890 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.169+0000 7f4260f24700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 0x7f424006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:52.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.170+0000 7f4260f24700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 0x7f424006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f60 tx=0x7f4250009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:52.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.174+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f425c06d840 con 0x7f425c15d890 2023-10-14T11:22:52.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.420+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f425c06d840 con 0x7f425c15d890 2023-10-14T11:22:52.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.420+0000 7f42597fa700 1 -- 172.21.15.67:0/4209953164 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f425c06d840 con 0x7f425c15d890 2023-10-14T11:22:52.422 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:52.423 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T11:22:52.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 msgr2=0x7f424006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 0x7f424006d330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4250000f60 tx=0x7f4250009040 comp rx=0 tx=0).stop 2023-10-14T11:22:52.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 msgr2=0x7f425c0c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:52.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4248014040 tx=0x7f4248004750 comp rx=0 tx=0).stop 2023-10-14T11:22:52.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 shutdown_connections 2023-10-14T11:22:52.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f425c15dc70 0x7f425c1f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f425c0cde50 0x7f425c15b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f424006ae70 0x7f424006d330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 --2- 172.21.15.67:0/4209953164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f425c15d890 0x7f425c0c9f10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:52.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 >> 172.21.15.67:0/4209953164 conn(0x7f425c0b16f0 msgr2=0x7f425c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:52.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 shutdown_connections 2023-10-14T11:22:52.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:52.422+0000 7f4263188700 1 -- 172.21.15.67:0/4209953164 wait complete. 2023-10-14T11:22:52.427 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 2 2023-10-14T11:22:54.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:22:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.576+0000 7fdd8b5b4700 1 Processor -- start 2023-10-14T11:22:54.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.576+0000 7fdd8b5b4700 1 -- start start 2023-10-14T11:22:54.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd8b5b4700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd8415d8d0 0x7fdd8415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd8b5b4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd840cd950 0x7fdd840cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd8b5b4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8415e270 con 0x7fdd84157aa0 2023-10-14T11:22:54.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd8b5b4700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840cf200 con 0x7fdd8415d8d0 2023-10-14T11:22:54.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd8b5b4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8406ebb0 con 0x7fdd840cd950 2023-10-14T11:22:54.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd8415d8d0 0x7fdd8415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd8415d8d0 0x7fdd8415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41072/0 (socket says 172.21.15.67:41072) 2023-10-14T11:22:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 -- 172.21.15.67:0/3366830816 learned_addr learned my addr 172.21.15.67:0/3366830816 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd89b51700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd840cd950 0x7fdd840cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 -- 172.21.15.67:0/3366830816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd840cd950 msgr2=0x7fdd840cddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd840cd950 0x7fdd840cddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 -- 172.21.15.67:0/3366830816 >> v1:172.21.15.72:6789/0 conn(0x7fdd84157aa0 legacy=0x7fdd840cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 -- 172.21.15.67:0/3366830816 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8406e720 con 0x7fdd8415d8d0 2023-10-14T11:22:54.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd88b4f700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8415d8d0 0x7fdd8415dd30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009920 tx=0x7fdd74009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c3253fe479d5bc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:54.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.577+0000 7fdd7bfff700 1 -- 172.21.15.67:0/3366830816 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011830 con 0x7fdd8415d8d0 2023-10-14T11:22:54.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd7bfff700 1 -- 172.21.15.67:0/3366830816 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74011990 con 0x7fdd8415d8d0 2023-10-14T11:22:54.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd7bfff700 1 -- 172.21.15.67:0/3366830816 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011d20 con 0x7fdd8415d8d0 2023-10-14T11:22:54.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/3366830816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8415d8d0 msgr2=0x7fdd8415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8415d8d0 0x7fdd8415dd30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009920 tx=0x7fdd74009c30 comp rx=0 tx=0).stop 2023-10-14T11:22:54.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/3366830816 shutdown_connections 2023-10-14T11:22:54.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd840cd950 0x7fdd840cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/3366830816 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd8415d8d0 0x7fdd8415dd30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/3366830816 >> 172.21.15.67:0/3366830816 conn(0x7fdd840b16f0 msgr2=0x7fdd840b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:54.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/3366830816 shutdown_connections 2023-10-14T11:22:54.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.578+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/3366830816 wait complete. 2023-10-14T11:22:54.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.579+0000 7fdd8b5b4700 1 Processor -- start 2023-10-14T11:22:54.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 -- start start 2023-10-14T11:22:54.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd840cd950 0x7fdd840ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd8415d8d0 0x7fdd8415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8415d420 con 0x7fdd84157aa0 2023-10-14T11:22:54.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840af350 con 0x7fdd840cd950 2023-10-14T11:22:54.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.580+0000 7fdd8b5b4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414a300 con 0x7fdd8415d8d0 2023-10-14T11:22:54.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41076/0 (socket says 172.21.15.67:41076) 2023-10-14T11:22:54.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 -- 172.21.15.67:0/4126115216 learned_addr learned my addr 172.21.15.67:0/4126115216 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:54.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd89b51700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd8415d8d0 0x7fdd8415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd89350700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd840cd950 0x7fdd840ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 -- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd8415d8d0 msgr2=0x7fdd8415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd8415d8d0 0x7fdd8415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 -- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd840cd950 msgr2=0x7fdd840ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd840cd950 0x7fdd840ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 -- 172.21.15.67:0/4126115216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74009550 con 0x7fdd84157aa0 2023-10-14T11:22:54.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd88b4f700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd74014040 tx=0x7fdd74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:54.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74004510 con 0x7fdd84157aa0 2023-10-14T11:22:54.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7401e070 con 0x7fdd84157aa0 2023-10-14T11:22:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd740038e0 con 0x7fdd84157aa0 2023-10-14T11:22:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.581+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd841499d0 con 0x7fdd84157aa0 2023-10-14T11:22:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.582+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd84149f90 con 0x7fdd84157aa0 2023-10-14T11:22:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.582+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8414a470 con 0x7fdd84157aa0 2023-10-14T11:22:54.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.584+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fdd74003a40 con 0x7fdd84157aa0 2023-10-14T11:22:54.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.584+0000 7fdd79ffb700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 0x7fdd6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.584+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd7408a280 con 0x7fdd84157aa0 2023-10-14T11:22:54.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.585+0000 7fdd89350700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 0x7fdd6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.585+0000 7fdd89350700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 0x7fdd6806d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdd8414ec10 tx=0x7fdd80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:54.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.589+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd740558d0 con 0x7fdd84157aa0 2023-10-14T11:22:54.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.838+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd8404ebb0 con 0x7fdd84157aa0 2023-10-14T11:22:54.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.839+0000 7fdd79ffb700 1 -- 172.21.15.67:0/4126115216 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fdd74020090 con 0x7fdd84157aa0 2023-10-14T11:22:54.841 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:54.842 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T11:22:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 msgr2=0x7fdd6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 0x7fdd6806d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdd8414ec10 tx=0x7fdd80009040 comp rx=0 tx=0).stop 2023-10-14T11:22:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 msgr2=0x7fdd840aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdd74014040 tx=0x7fdd74004750 comp rx=0 tx=0).stop 2023-10-14T11:22:54.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 shutdown_connections 2023-10-14T11:22:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd8415d8d0 0x7fdd8415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd840cd950 0x7fdd840ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd6806ae70 0x7fdd6806d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 --2- 172.21.15.67:0/4126115216 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd84157aa0 0x7fdd840aee10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.841+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 >> 172.21.15.67:0/4126115216 conn(0x7fdd840b16f0 msgr2=0x7fdd840cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.842+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 shutdown_connections 2023-10-14T11:22:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.842+0000 7fdd8b5b4700 1 -- 172.21.15.67:0/4126115216 wait complete. 2023-10-14T11:22:54.846 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 3 2023-10-14T11:22:54.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:54.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.979+0000 7fa306b0a700 1 Processor -- start 2023-10-14T11:22:54.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.979+0000 7fa306b0a700 1 -- start start 2023-10-14T11:22:54.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa306b0a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa3000d01b0 0x7fa300166a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa306b0a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000cef10 con 0x7fa3000b04c0 2023-10-14T11:22:54.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa306b0a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000d2090 con 0x7fa3000ceb30 2023-10-14T11:22:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa306b0a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30015deb0 con 0x7fa3000d01b0 2023-10-14T11:22:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa3050a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa3000d01b0 0x7fa300166a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa2fffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa3000b04c0 0x7fa3000cfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40380/0 (socket says 172.21.15.67:40380) 2023-10-14T11:22:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.980+0000 7fa2fffff700 1 -- 172.21.15.67:0/1861268027 learned_addr learned my addr 172.21.15.67:0/1861268027 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:54.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa3050a7700 1 -- 172.21.15.67:0/1861268027 >> v1:172.21.15.72:6789/0 conn(0x7fa3000ceb30 legacy=0x7fa3000cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa2ff7fe700 1 -- 172.21.15.67:0/1861268027 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930572974 0 0) 0x7fa3000cef10 con 0x7fa3000b04c0 2023-10-14T11:22:54.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa3050a7700 1 -- 172.21.15.67:0/1861268027 >> v1:172.21.15.67:6789/0 conn(0x7fa3000b04c0 legacy=0x7fa3000cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa3050a7700 1 -- 172.21.15.67:0/1861268027 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000d22e0 con 0x7fa3000d01b0 2023-10-14T11:22:54.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa3050a7700 1 --2- 172.21.15.67:0/1861268027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000d01b0 0x7fa300166a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ac49e5f99fbcf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:54.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa2ff7fe700 1 -- 172.21.15.67:0/1861268027 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800e070 con 0x7fa3000d01b0 2023-10-14T11:22:54.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa2ff7fe700 1 -- 172.21.15.67:0/1861268027 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800bbd0 con 0x7fa3000d01b0 2023-10-14T11:22:54.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.981+0000 7fa2ff7fe700 1 -- 172.21.15.67:0/1861268027 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8012430 con 0x7fa3000d01b0 2023-10-14T11:22:54.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 -- 172.21.15.67:0/1861268027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000d01b0 msgr2=0x7fa300166a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 --2- 172.21.15.67:0/1861268027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000d01b0 0x7fa300166a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009d90 tx=0x7fa2f800b330 comp rx=0 tx=0).stop 2023-10-14T11:22:54.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 -- 172.21.15.67:0/1861268027 shutdown_connections 2023-10-14T11:22:54.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 --2- 172.21.15.67:0/1861268027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000d01b0 0x7fa300166a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 -- 172.21.15.67:0/1861268027 >> 172.21.15.67:0/1861268027 conn(0x7fa3000d1570 msgr2=0x7fa3000d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:54.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 -- 172.21.15.67:0/1861268027 shutdown_connections 2023-10-14T11:22:54.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.982+0000 7fa306b0a700 1 -- 172.21.15.67:0/1861268027 wait complete. 2023-10-14T11:22:54.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.983+0000 7fa306b0a700 1 Processor -- start 2023-10-14T11:22:54.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.983+0000 7fa306b0a700 1 -- start start 2023-10-14T11:22:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000ceb30 0x7fa3000b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3000d01b0 0x7fa3000cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c60f0 con 0x7fa3000b04c0 2023-10-14T11:22:54.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b50b0 con 0x7fa3000ceb30 2023-10-14T11:22:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa306b0a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b5390 con 0x7fa3000d01b0 2023-10-14T11:22:54.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa3048a6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa3048a6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41090/0 (socket says 172.21.15.67:41090) 2023-10-14T11:22:54.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa3048a6700 1 -- 172.21.15.67:0/4221593874 learned_addr learned my addr 172.21.15.67:0/4221593874 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:54.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa3050a7700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3000d01b0 0x7fa3000cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.984+0000 7fa2fffff700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000ceb30 0x7fa3000b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:54.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 -- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3000d01b0 msgr2=0x7fa3000cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3000d01b0 0x7fa3000cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 -- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000ceb30 msgr2=0x7fa3000b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:54.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000ceb30 0x7fa3000b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:54.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 -- 172.21.15.67:0/4221593874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8009a70 con 0x7fa3000b04c0 2023-10-14T11:22:54.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa3048a6700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c450 tx=0x7fa2f400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:54.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40052d0 con 0x7fa3000b04c0 2023-10-14T11:22:54.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4005430 con 0x7fa3000b04c0 2023-10-14T11:22:54.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000b5670 con 0x7fa3000b04c0 2023-10-14T11:22:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40038c0 con 0x7fa3000b04c0 2023-10-14T11:22:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.985+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30015b4a0 con 0x7fa3000b04c0 2023-10-14T11:22:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.986+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30004ebb0 con 0x7fa3000b04c0 2023-10-14T11:22:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.987+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fa2f4003a20 con 0x7fa3000b04c0 2023-10-14T11:22:54.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.988+0000 7fa2fd7fa700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 0x7fa2e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.988+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2f4088400 con 0x7fa3000b04c0 2023-10-14T11:22:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.988+0000 7fa2fffff700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 0x7fa2e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.989+0000 7fa2fffff700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 0x7fa2e406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa30015bcc0 tx=0x7fa2ec007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:54.993+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa2f4053970 con 0x7fa3000b04c0 2023-10-14T11:22:55.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.203+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa30015c0b0 con 0x7fa3000b04c0 2023-10-14T11:22:55.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.204+0000 7fa2fd7fa700 1 -- 172.21.15.67:0/4221593874 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12803 (secure 0 0 0) 0x7fa2f400ce60 con 0x7fa3000b04c0 2023-10-14T11:22:55.206 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:55.206 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:54.420235+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:55.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 msgr2=0x7fa2e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 0x7fa2e406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa30015bcc0 tx=0x7fa2ec007e70 comp rx=0 tx=0).stop 2023-10-14T11:22:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 msgr2=0x7fa30015af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c450 tx=0x7fa2f400c760 comp rx=0 tx=0).stop 2023-10-14T11:22:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 shutdown_connections 2023-10-14T11:22:55.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3000d01b0 0x7fa3000cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa2e406ae70 0x7fa2e406d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3000b04c0 0x7fa30015af60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 --2- 172.21.15.67:0/4221593874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3000ceb30 0x7fa3000b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 >> 172.21.15.67:0/4221593874 conn(0x7fa3000d1570 msgr2=0x7fa3000d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 shutdown_connections 2023-10-14T11:22:55.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.206+0000 7fa306b0a700 1 -- 172.21.15.67:0/4221593874 wait complete. 2023-10-14T11:22:55.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:22:55.221 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:22:55.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.346+0000 7faafe753700 1 Processor -- start 2023-10-14T11:22:55.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.346+0000 7faafe753700 1 -- start start 2023-10-14T11:22:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafe753700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 0x7faaf806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafe753700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf815e200 con 0x7faaf806bb20 2023-10-14T11:22:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafe753700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf815f040 con 0x7faaf815de20 2023-10-14T11:22:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafe753700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf815f320 con 0x7faaf80ce850 2023-10-14T11:22:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafccf0700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faaf806bb20 0x7faaf815e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40396/0 (socket says 172.21.15.67:40396) 2023-10-14T11:22:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faafccf0700 1 -- 172.21.15.67:0/1840408822 learned_addr learned my addr 172.21.15.67:0/1840408822 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:55.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.347+0000 7faaf77fe700 1 --2- 172.21.15.67:0/1840408822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 0x7faaf806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008147957 0 0) 0x7faaf815e200 con 0x7faaf806bb20 2023-10-14T11:22:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faae00035b0 con 0x7faaf806bb20 2023-10-14T11:22:55.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987508269 0 0) 0x7faaf815f040 con 0x7faaf815de20 2023-10-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf77fe700 1 -- 172.21.15.67:0/1840408822 >> v1:172.21.15.72:6789/0 conn(0x7faaf815de20 legacy=0x7faaf80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf77fe700 1 -- 172.21.15.67:0/1840408822 >> v1:172.21.15.67:6789/0 conn(0x7faaf806bb20 legacy=0x7faaf815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf77fe700 1 -- 172.21.15.67:0/1840408822 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf80b2320 con 0x7faaf80ce850 2023-10-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf77fe700 1 --2- 172.21.15.67:0/1840408822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 0x7faaf806d3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9274855df75542 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011830 con 0x7faaf80ce850 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec011990 con 0x7faaf80ce850 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.348+0000 7faaf6ffd700 1 -- 172.21.15.67:0/1840408822 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011d20 con 0x7faaf80ce850 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 -- 172.21.15.67:0/1840408822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 msgr2=0x7faaf806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 --2- 172.21.15.67:0/1840408822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 0x7faaf806d3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faaec009870 tx=0x7faaec009b80 comp rx=0 tx=0).stop 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 -- 172.21.15.67:0/1840408822 shutdown_connections 2023-10-14T11:22:55.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 --2- 172.21.15.67:0/1840408822 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf80ce850 0x7faaf806d3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 -- 172.21.15.67:0/1840408822 >> 172.21.15.67:0/1840408822 conn(0x7faaf80b1760 msgr2=0x7faaf80b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 -- 172.21.15.67:0/1840408822 shutdown_connections 2023-10-14T11:22:55.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.349+0000 7faafe753700 1 -- 172.21.15.67:0/1840408822 wait complete. 2023-10-14T11:22:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.350+0000 7faafe753700 1 Processor -- start 2023-10-14T11:22:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.350+0000 7faafe753700 1 -- start start 2023-10-14T11:22:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf806bb20 0x7faaf8156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faaf815de20 0x7faaf80afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80a0540 con 0x7faaf80ce850 2023-10-14T11:22:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80b0690 con 0x7faaf815de20 2023-10-14T11:22:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafe753700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf80cbb00 con 0x7faaf806bb20 2023-10-14T11:22:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41106/0 (socket says 172.21.15.67:41106) 2023-10-14T11:22:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 -- 172.21.15.67:0/2255115284 learned_addr learned my addr 172.21.15.67:0/2255115284 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf7fff700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf806bb20 0x7faaf8156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faafccf0700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faaf815de20 0x7faaf80afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 -- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf806bb20 msgr2=0x7faaf8156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf806bb20 0x7faaf8156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 -- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faaf815de20 msgr2=0x7faaf80afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faaf815de20 0x7faaf80afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 -- 172.21.15.67:0/2255115284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0094a0 con 0x7faaf80ce850 2023-10-14T11:22:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf77fe700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaec0090b0 tx=0x7faaec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec01a7e0 con 0x7faaf80ce850 2023-10-14T11:22:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec01a940 con 0x7faaf80ce850 2023-10-14T11:22:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.351+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec01acf0 con 0x7faaf80ce850 2023-10-14T11:22:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.352+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf806d3b0 con 0x7faaf80ce850 2023-10-14T11:22:55.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.352+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf80b0340 con 0x7faaf80ce850 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.352+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf8066fb0 con 0x7faaf80ce850 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.353+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7faaec022070 con 0x7faaf80ce850 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.353+0000 7faaf4ff9700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.353+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faaec089e10 con 0x7faaf80ce850 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.353+0000 7faaf7fff700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.354+0000 7faaf7fff700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 0x7faae406d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae8007fd0 tx=0x7faae8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.358+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faaec055400 con 0x7faaf80ce850 2023-10-14T11:22:55.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.563+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaf804ebb0 con 0x7faaf80ce850 2023-10-14T11:22:55.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.564+0000 7faaf4ff9700 1 -- 172.21.15.67:0/2255115284 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7faaec0290a0 con 0x7faaf80ce850 2023-10-14T11:22:55.566 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:22:55.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 msgr2=0x7faae406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 0x7faae406d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae8007fd0 tx=0x7faae8009040 comp rx=0 tx=0).stop 2023-10-14T11:22:55.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 msgr2=0x7faaf80af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaec0090b0 tx=0x7faaec004750 comp rx=0 tx=0).stop 2023-10-14T11:22:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 shutdown_connections 2023-10-14T11:22:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faaf815de20 0x7faaf80afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faaf806bb20 0x7faaf8156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faae406ae70 0x7faae406d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 --2- 172.21.15.67:0/2255115284 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faaf80ce850 0x7faaf80af8c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 >> 172.21.15.67:0/2255115284 conn(0x7faaf80b1760 msgr2=0x7faaf8071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 shutdown_connections 2023-10-14T11:22:55.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.566+0000 7faafe753700 1 -- 172.21.15.67:0/2255115284 wait complete. 2023-10-14T11:22:55.580 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T11:22:55.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.704+0000 7f60f3345700 1 Processor -- start 2023-10-14T11:22:55.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.704+0000 7f60f3345700 1 -- start start 2023-10-14T11:22:55.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f3345700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60ec06d260 0x7f60ec1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f3345700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec06d6e0 con 0x7f60ec161e10 2023-10-14T11:22:55.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f3345700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec06cdd0 con 0x7f60ec15def0 2023-10-14T11:22:55.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f3345700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec1622a0 con 0x7f60ec06d260 2023-10-14T11:22:55.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f18e2700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f60ec161e10 0x7f60ec15f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40408/0 (socket says 172.21.15.67:40408) 2023-10-14T11:22:55.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f18e2700 1 -- 172.21.15.67:0/3821646893 learned_addr learned my addr 172.21.15.67:0/3821646893 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f08e0700 1 --2- 172.21.15.67:0/3821646893 >> v2:172.21.15.72:3300/0 conn(0x7f60ec06d260 0x7f60ec1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769646187 0 0) 0x7f60e4001490 con 0x7f60ec161e10 2023-10-14T11:22:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d80035b0 con 0x7f60ec161e10 2023-10-14T11:22:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f08e0700 1 -- 172.21.15.67:0/3821646893 >> v1:172.21.15.72:6789/0 conn(0x7f60ec15def0 legacy=0x7f60ec0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261442288 0 0) 0x7f60ec06cdd0 con 0x7f60ec15def0 2023-10-14T11:22:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f08e0700 1 -- 172.21.15.67:0/3821646893 >> v1:172.21.15.67:6789/0 conn(0x7f60ec161e10 legacy=0x7f60ec15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f08e0700 1 -- 172.21.15.67:0/3821646893 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec06c1c0 con 0x7f60ec06d260 2023-10-14T11:22:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.705+0000 7f60f08e0700 1 --2- 172.21.15.67:0/3821646893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec1618d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009840 tx=0x7f60dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b187c227c9b3f92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc011830 con 0x7f60ec06d260 2023-10-14T11:22:55.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc011990 con 0x7f60ec06d260 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60e3fff700 1 -- 172.21.15.67:0/3821646893 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc011d00 con 0x7f60ec06d260 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 -- 172.21.15.67:0/3821646893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 msgr2=0x7f60ec1618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 --2- 172.21.15.67:0/3821646893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec1618d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009840 tx=0x7f60dc009b50 comp rx=0 tx=0).stop 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 -- 172.21.15.67:0/3821646893 shutdown_connections 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 --2- 172.21.15.67:0/3821646893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec1618d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 -- 172.21.15.67:0/3821646893 >> 172.21.15.67:0/3821646893 conn(0x7f60ec0d1570 msgr2=0x7f60ec0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:55.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 -- 172.21.15.67:0/3821646893 shutdown_connections 2023-10-14T11:22:55.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.706+0000 7f60f3345700 1 -- 172.21.15.67:0/3821646893 wait complete. 2023-10-14T11:22:55.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.707+0000 7f60f3345700 1 Processor -- start 2023-10-14T11:22:55.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.707+0000 7f60f3345700 1 -- start start 2023-10-14T11:22:55.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60ec15def0 0x7f60ec06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0b0f80 con 0x7f60ec161e10 2023-10-14T11:22:55.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0c79e0 con 0x7f60ec06d260 2023-10-14T11:22:55.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f3345700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0c7cc0 con 0x7f60ec15def0 2023-10-14T11:22:55.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f18e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f18e2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41122/0 (socket says 172.21.15.67:41122) 2023-10-14T11:22:55.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f18e2700 1 -- 172.21.15.67:0/3985880193 learned_addr learned my addr 172.21.15.67:0/3985880193 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:55.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.708+0000 7f60f10e1700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f08e0700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60ec15def0 0x7f60ec06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 -- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60ec15def0 msgr2=0x7f60ec06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60ec15def0 0x7f60ec06fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 -- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 msgr2=0x7f60ec158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 -- 172.21.15.67:0/3985880193 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0094a0 con 0x7f60ec161e10 2023-10-14T11:22:55.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f10e1700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:55.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f18e2700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e400cb40 tx=0x7f60e400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400ab50 con 0x7f60ec161e10 2023-10-14T11:22:55.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400acb0 con 0x7f60ec161e10 2023-10-14T11:22:55.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec0b0ba0 con 0x7f60ec161e10 2023-10-14T11:22:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4012620 con 0x7f60ec161e10 2023-10-14T11:22:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.709+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ec0c6e70 con 0x7f60ec161e10 2023-10-14T11:22:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.710+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ec0b0a00 con 0x7f60ec161e10 2023-10-14T11:22:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.711+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f60e401b3b0 con 0x7f60ec161e10 2023-10-14T11:22:55.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.711+0000 7f60e1ffb700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:55.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.711+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60e4088d80 con 0x7f60ec161e10 2023-10-14T11:22:55.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.711+0000 7f60f10e1700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:55.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.711+0000 7f60f10e1700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 0x7f60d006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e8007fd0 tx=0x7f60e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:55.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.716+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f60ec0b0a00 con 0x7f60ec161e10 2023-10-14T11:22:55.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.920+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60ec0b0a00 con 0x7f60ec161e10 2023-10-14T11:22:55.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.921+0000 7f60e1ffb700 1 -- 172.21.15.67:0/3985880193 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f60e4017060 con 0x7f60ec161e10 2023-10-14T11:22:55.923 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:55.924 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2023-10-14T11:22:55.924 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:22:55.924 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2023-10-14T11:22:55.924 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2023-10-14T11:22:55.924 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:22:55.925 INFO:teuthology.orchestra.run.smithi067.stdout:] 2023-10-14T11:22:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 msgr2=0x7f60d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 0x7f60d006d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e8007fd0 tx=0x7f60e8009040 comp rx=0 tx=0).stop 2023-10-14T11:22:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 msgr2=0x7f60ec070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:55.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f60e400cb40 tx=0x7f60e400cf00 comp rx=0 tx=0).stop 2023-10-14T11:22:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 shutdown_connections 2023-10-14T11:22:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f60d006ae70 0x7f60d006d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f60ec161e10 0x7f60ec070280 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60ec06d260 0x7f60ec158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 --2- 172.21.15.67:0/3985880193 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f60ec15def0 0x7f60ec06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 >> 172.21.15.67:0/3985880193 conn(0x7f60ec0d1570 msgr2=0x7f60ec15e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 shutdown_connections 2023-10-14T11:22:55.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:55.923+0000 7f60f3345700 1 -- 172.21.15.67:0/3985880193 wait complete. 2023-10-14T11:22:55.937 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T11:22:55.937 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T11:22:56.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.064+0000 7f5f12770700 1 Processor -- start 2023-10-14T11:22:56.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.064+0000 7f5f12770700 1 -- start start 2023-10-14T11:22:56.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f12770700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f0c0cf990 0x7f5f0c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f12770700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 0x7f5f0c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f12770700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0cc530 con 0x7f5f0c15a580 2023-10-14T11:22:56.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f12770700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b6260 con 0x7f5f0c0cf990 2023-10-14T11:22:56.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f12770700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c072de0 con 0x7f5f0c072870 2023-10-14T11:22:56.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0bfff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5f0c15a580 0x7f5f0c0cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40420/0 (socket says 172.21.15.67:40420) 2023-10-14T11:22:56.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0bfff700 1 -- 172.21.15.67:0/3496516706 learned_addr learned my addr 172.21.15.67:0/3496516706 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:56.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f10d0d700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 0x7f5f0c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/3496516706 >> v2:172.21.15.72:3300/0 conn(0x7f5f0c0cf990 0x7f5f0c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0affd700 1 -- 172.21.15.67:0/3496516706 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909274422 0 0) 0x7f5f0c0cc530 con 0x7f5f0c15a580 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0affd700 1 -- 172.21.15.67:0/3496516706 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef80035b0 con 0x7f5f0c15a580 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0b7fe700 1 -- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 msgr2=0x7f5f0c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 0x7f5f0c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0b7fe700 1 -- 172.21.15.67:0/3496516706 >> v1:172.21.15.67:6789/0 conn(0x7f5f0c15a580 legacy=0x7f5f0c0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f0b7fe700 1 -- 172.21.15.67:0/3496516706 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0cbee0 con 0x7f5f0c0cf990 2023-10-14T11:22:56.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.065+0000 7f5f10d0d700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 0x7f5f0c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:22:56.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c0cf990 0x7f5f0c06fcb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009840 tx=0x7f5efc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e04c094fc034e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f0affd700 1 -- 172.21.15.67:0/3496516706 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc011830 con 0x7f5f0c0cf990 2023-10-14T11:22:56.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f0affd700 1 -- 172.21.15.67:0/3496516706 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc011990 con 0x7f5f0c0cf990 2023-10-14T11:22:56.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f0affd700 1 -- 172.21.15.67:0/3496516706 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc011d00 con 0x7f5f0c0cf990 2023-10-14T11:22:56.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 -- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c0cf990 msgr2=0x7f5f0c06fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c0cf990 0x7f5f0c06fcb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009840 tx=0x7f5efc009b50 comp rx=0 tx=0).stop 2023-10-14T11:22:56.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 -- 172.21.15.67:0/3496516706 shutdown_connections 2023-10-14T11:22:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c072870 0x7f5f0c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 --2- 172.21.15.67:0/3496516706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c0cf990 0x7f5f0c06fcb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 -- 172.21.15.67:0/3496516706 >> 172.21.15.67:0/3496516706 conn(0x7f5f0c06db70 msgr2=0x7f5f0c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:56.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 -- 172.21.15.67:0/3496516706 shutdown_connections 2023-10-14T11:22:56.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.066+0000 7f5f12770700 1 -- 172.21.15.67:0/3496516706 wait complete. 2023-10-14T11:22:56.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.067+0000 7f5f12770700 1 Processor -- start 2023-10-14T11:22:56.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 -- start start 2023-10-14T11:22:56.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c0cf990 0x7f5f0c1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c15a580 0x7f5f0c0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0aef40 con 0x7f5f0c072870 2023-10-14T11:22:56.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c1f3b90 con 0x7f5f0c15a580 2023-10-14T11:22:56.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f12770700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c15bd30 con 0x7f5f0c0cf990 2023-10-14T11:22:56.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.068+0000 7f5f0bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41132/0 (socket says 172.21.15.67:41132) 2023-10-14T11:22:56.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 -- 172.21.15.67:0/4097847667 learned_addr learned my addr 172.21.15.67:0/4097847667 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:56.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c0cf990 0x7f5f0c1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f10d0d700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c15a580 0x7f5f0c0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 -- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c0cf990 msgr2=0x7f5f0c1f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c0cf990 0x7f5f0c1f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 -- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c15a580 msgr2=0x7f5f0c0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c15a580 0x7f5f0c0ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 -- 172.21.15.67:0/4097847667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009a70 con 0x7f5f0c072870 2023-10-14T11:22:56.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f0bfff700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c420 tx=0x7f5ef400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4005d70 con 0x7f5f0c072870 2023-10-14T11:22:56.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400ce20 con 0x7f5f0c072870 2023-10-14T11:22:56.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0094a0 con 0x7f5f0c072870 2023-10-14T11:22:56.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40072d0 con 0x7f5f0c072870 2023-10-14T11:22:56.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.069+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c15b520 con 0x7f5f0c072870 2023-10-14T11:22:56.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.070+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c15afc0 con 0x7f5f0c072870 2023-10-14T11:22:56.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.071+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f5ef4007430 con 0x7f5f0c072870 2023-10-14T11:22:56.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.071+0000 7f5f08ff9700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 0x7f5eec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.071+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ef40883e0 con 0x7f5f0c072870 2023-10-14T11:22:56.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.071+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 0x7f5eec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.072+0000 7f5f0b7fe700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 0x7f5eec06d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.076+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ef40538f0 con 0x7f5f0c072870 2023-10-14T11:22:56.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.278+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5f0c04ebb0 con 0x7f5f0c072870 2023-10-14T11:22:56.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.582+0000 7f5f08ff9700 1 -- 172.21.15.67:0/4097847667 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5ef4056f10 con 0x7f5f0c072870 2023-10-14T11:22:56.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 msgr2=0x7f5eec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 0x7f5eec06d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5efc000c00 tx=0x7f5efc008030 comp rx=0 tx=0).stop 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 msgr2=0x7f5f0c15a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c420 tx=0x7f5ef400c730 comp rx=0 tx=0).stop 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 shutdown_connections 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f0c15a580 0x7f5f0c0ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5eec06ae70 0x7f5eec06d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f0c072870 0x7f5f0c15a960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 --2- 172.21.15.67:0/4097847667 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f0c0cf990 0x7f5f0c1f3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 >> 172.21.15.67:0/4097847667 conn(0x7f5f0c06db70 msgr2=0x7f5f0c0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:56.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 shutdown_connections 2023-10-14T11:22:56.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.585+0000 7f5f12770700 1 -- 172.21.15.67:0/4097847667 wait complete. 2023-10-14T11:22:56.590 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' created 2023-10-14T11:22:56.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T11:22:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.736+0000 7fb5036fc700 1 Processor -- start 2023-10-14T11:22:56.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.736+0000 7fb5036fc700 1 -- start start 2023-10-14T11:22:56.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb5036fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb5036fc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0b0f90 con 0x7fb4fc06b3b0 2023-10-14T11:22:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb5036fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc0cc820 con 0x7fb4fc0b0bb0 2023-10-14T11:22:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb5036fc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc0cde00 con 0x7fb4fc0b1960 2023-10-14T11:22:56.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb501c99700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb500c97700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb4fc06b3b0 0x7fb4fc0b1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40436/0 (socket says 172.21.15.67:40436) 2023-10-14T11:22:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb501c99700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41144/0 (socket says 172.21.15.67:41144) 2023-10-14T11:22:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb500c97700 1 -- 172.21.15.67:0/4037059858 learned_addr learned my addr 172.21.15.67:0/4037059858 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb501c99700 1 -- 172.21.15.67:0/4037059858 >> v1:172.21.15.72:6789/0 conn(0x7fb4fc0b0bb0 legacy=0x7fb4fc0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:56.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb501c99700 1 -- 172.21.15.67:0/4037059858 >> v1:172.21.15.67:6789/0 conn(0x7fb4fc06b3b0 legacy=0x7fb4fc0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb4f3fff700 1 -- 172.21.15.67:0/4037059858 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609805185 0 0) 0x7fb4fc0b0f90 con 0x7fb4fc06b3b0 2023-10-14T11:22:56.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.737+0000 7fb501c99700 1 -- 172.21.15.67:0/4037059858 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0ccb00 con 0x7fb4fc0b1960 2023-10-14T11:22:56.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb501c99700 1 --2- 172.21.15.67:0/4037059858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc161660 tx=0x7fb4f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c238144ad8778a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb4f3fff700 1 -- 172.21.15.67:0/4037059858 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400e070 con 0x7fb4fc0b1960 2023-10-14T11:22:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb4f3fff700 1 -- 172.21.15.67:0/4037059858 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400bbd0 con 0x7fb4fc0b1960 2023-10-14T11:22:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb4f3fff700 1 -- 172.21.15.67:0/4037059858 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4012430 con 0x7fb4fc0b1960 2023-10-14T11:22:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 -- 172.21.15.67:0/4037059858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 msgr2=0x7fb4fc0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 --2- 172.21.15.67:0/4037059858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc161660 tx=0x7fb4f400b330 comp rx=0 tx=0).stop 2023-10-14T11:22:56.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 -- 172.21.15.67:0/4037059858 shutdown_connections 2023-10-14T11:22:56.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 --2- 172.21.15.67:0/4037059858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc0cd8c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 -- 172.21.15.67:0/4037059858 >> 172.21.15.67:0/4037059858 conn(0x7fb4fc0d04b0 msgr2=0x7fb4fc0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:56.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 -- 172.21.15.67:0/4037059858 shutdown_connections 2023-10-14T11:22:56.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.738+0000 7fb5036fc700 1 -- 172.21.15.67:0/4037059858 wait complete. 2023-10-14T11:22:56.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.740+0000 7fb5036fc700 1 Processor -- start 2023-10-14T11:22:56.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.740+0000 7fb5036fc700 1 -- start start 2023-10-14T11:22:56.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc06b3b0 0x7fb4fc14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc0b0bb0 0x7fb4fc0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc14cee0 con 0x7fb4fc0b1960 2023-10-14T11:22:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0ad740 con 0x7fb4fc06b3b0 2023-10-14T11:22:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb5036fc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15fbf0 con 0x7fb4fc0b0bb0 2023-10-14T11:22:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41150/0 (socket says 172.21.15.67:41150) 2023-10-14T11:22:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 -- 172.21.15.67:0/2557853079 learned_addr learned my addr 172.21.15.67:0/2557853079 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb500c97700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc0b0bb0 0x7fb4fc0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501498700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc06b3b0 0x7fb4fc14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 -- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc0b0bb0 msgr2=0x7fb4fc0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc0b0bb0 0x7fb4fc0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 -- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc06b3b0 msgr2=0x7fb4fc14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc06b3b0 0x7fb4fc14c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 -- 172.21.15.67:0/2557853079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f4009a70 con 0x7fb4fc0b1960 2023-10-14T11:22:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.741+0000 7fb501c99700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4014040 tx=0x7fb4f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.742+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4012430 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.742+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f4020070 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.742+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4004280 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.742+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4fc0b0030 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.742+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc15fe00 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.743+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc04ebb0 con 0x7fb4fc0b1960 2023-10-14T11:22:56.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.743+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb4f40043e0 con 0x7fb4fc0b1960 2023-10-14T11:22:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.744+0000 7fb4f1ffb700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.744+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb4f4022070 con 0x7fb4fc0b1960 2023-10-14T11:22:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.744+0000 7fb501498700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:56.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.745+0000 7fb501498700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 0x7fb4e006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc15c260 tx=0x7fb4ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:56.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.748+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4f40565d0 con 0x7fb4fc0b1960 2023-10-14T11:22:56.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:56.954+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4fc071ea0 con 0x7fb4fc0b1960 2023-10-14T11:22:57.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.585+0000 7fb4f1ffb700 1 -- 172.21.15.67:0/2557853079 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb4f4059bf0 con 0x7fb4fc0b1960 2023-10-14T11:22:57.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.588+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 msgr2=0x7fb4e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.588+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 0x7fb4e006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc15c260 tx=0x7fb4ec009040 comp rx=0 tx=0).stop 2023-10-14T11:22:57.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.588+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 msgr2=0x7fb4fc1608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.588+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4014040 tx=0x7fb4f4004ad0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 shutdown_connections 2023-10-14T11:22:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb4e006af00 0x7fb4e006d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4fc0b1960 0x7fb4fc1608e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4fc06b3b0 0x7fb4fc14c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 --2- 172.21.15.67:0/2557853079 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4fc0b0bb0 0x7fb4fc0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 >> 172.21.15.67:0/2557853079 conn(0x7fb4fc0d04b0 msgr2=0x7fb4fc15d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:57.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 shutdown_connections 2023-10-14T11:22:57.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.589+0000 7fb5036fc700 1 -- 172.21.15.67:0/2557853079 wait complete. 2023-10-14T11:22:57.599 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' created 2023-10-14T11:22:57.617 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T11:22:57.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.745+0000 7fb926641700 1 Processor -- start 2023-10-14T11:22:57.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.745+0000 7fb926641700 1 -- start start 2023-10-14T11:22:57.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb926641700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb92006b3b0 0x7fb9200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb926641700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9200b1250 0x7fb9200b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb926641700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9200b0f90 con 0x7fb9200b0bb0 2023-10-14T11:22:57.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb926641700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9200cde00 con 0x7fb9200b1250 2023-10-14T11:22:57.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb926641700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200b1c20 con 0x7fb92006b3b0 2023-10-14T11:22:57.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb924bde700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9200b1250 0x7fb9200b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb924bde700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb9200b1250 0x7fb9200b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41158/0 (socket says 172.21.15.67:41158) 2023-10-14T11:22:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb924bde700 1 -- 172.21.15.67:0/3523373581 learned_addr learned my addr 172.21.15.67:0/3523373581 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.746+0000 7fb91f7fe700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb92006b3b0 0x7fb9200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb924bde700 1 -- 172.21.15.67:0/3523373581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb92006b3b0 msgr2=0x7fb9200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:57.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb924bde700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb92006b3b0 0x7fb9200cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb924bde700 1 -- 172.21.15.67:0/3523373581 >> v1:172.21.15.72:6789/0 conn(0x7fb9200b0bb0 legacy=0x7fb9200cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb924bde700 1 -- 172.21.15.67:0/3523373581 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200cc820 con 0x7fb9200b1250 2023-10-14T11:22:57.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb924bde700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b1250 0x7fb9200b16e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb918009e50 tx=0x7fb91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb87a7051fbbaae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:57.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb91effd700 1 -- 172.21.15.67:0/3523373581 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800e070 con 0x7fb9200b1250 2023-10-14T11:22:57.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb91effd700 1 -- 172.21.15.67:0/3523373581 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800b910 con 0x7fb9200b1250 2023-10-14T11:22:57.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.747+0000 7fb91effd700 1 -- 172.21.15.67:0/3523373581 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800bcc0 con 0x7fb9200b1250 2023-10-14T11:22:57.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 -- 172.21.15.67:0/3523373581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b1250 msgr2=0x7fb9200b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b1250 0x7fb9200b16e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb918009e50 tx=0x7fb91800b330 comp rx=0 tx=0).stop 2023-10-14T11:22:57.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 -- 172.21.15.67:0/3523373581 shutdown_connections 2023-10-14T11:22:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b1250 0x7fb9200b16e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 --2- 172.21.15.67:0/3523373581 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb92006b3b0 0x7fb9200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 -- 172.21.15.67:0/3523373581 >> 172.21.15.67:0/3523373581 conn(0x7fb9200d04b0 msgr2=0x7fb9200d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 -- 172.21.15.67:0/3523373581 shutdown_connections 2023-10-14T11:22:57.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.748+0000 7fb926641700 1 -- 172.21.15.67:0/3523373581 wait complete. 2023-10-14T11:22:57.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.749+0000 7fb926641700 1 Processor -- start 2023-10-14T11:22:57.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.749+0000 7fb926641700 1 -- start start 2023-10-14T11:22:57.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb92006b3b0 0x7fb92015bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9200b1250 0x7fb92014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200c7ce0 con 0x7fb9200b0bb0 2023-10-14T11:22:57.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92014fd50 con 0x7fb92006b3b0 2023-10-14T11:22:57.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb926641700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9200c8fb0 con 0x7fb9200b1250 2023-10-14T11:22:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41162/0 (socket says 172.21.15.67:41162) 2023-10-14T11:22:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 -- 172.21.15.67:0/839711587 learned_addr learned my addr 172.21.15.67:0/839711587 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb924bde700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9200b1250 0x7fb92014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91ffff700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb92006b3b0 0x7fb92015bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 -- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9200b1250 msgr2=0x7fb92014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9200b1250 0x7fb92014f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 -- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb92006b3b0 msgr2=0x7fb92015bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:57.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb92006b3b0 0x7fb92015bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:57.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.750+0000 7fb91f7fe700 1 -- 172.21.15.67:0/839711587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918009b30 con 0x7fb9200b0bb0 2023-10-14T11:22:57.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb91f7fe700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb90800e9b0 tx=0x7fb90800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:57.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908009710 con 0x7fb9200b0bb0 2023-10-14T11:22:57.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90800ee50 con 0x7fb9200b0bb0 2023-10-14T11:22:57.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9200c8cd0 con 0x7fb9200b0bb0 2023-10-14T11:22:57.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90800c9f0 con 0x7fb9200b0bb0 2023-10-14T11:22:57.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.751+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9200c7900 con 0x7fb9200b0bb0 2023-10-14T11:22:57.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.752+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92004ebb0 con 0x7fb9200b0bb0 2023-10-14T11:22:57.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.753+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb90800cb50 con 0x7fb9200b0bb0 2023-10-14T11:22:57.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.753+0000 7fb91cff9700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 0x7fb90006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:57.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.753+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb908089860 con 0x7fb9200b0bb0 2023-10-14T11:22:57.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.753+0000 7fb91ffff700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 0x7fb90006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:57.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.754+0000 7fb91ffff700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 0x7fb90006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb910007fd0 tx=0x7fb910009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:57.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:57.758+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb908054970 con 0x7fb9200b0bb0 2023-10-14T11:22:58.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.002+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb920071ea0 con 0x7fb9200b0bb0 2023-10-14T11:22:58.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.610+0000 7fb91cff9700 1 -- 172.21.15.67:0/839711587 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb9080170c0 con 0x7fb9200b0bb0 2023-10-14T11:22:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.621+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 msgr2=0x7fb90006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.621+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 0x7fb90006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb910007fd0 tx=0x7fb910009040 comp rx=0 tx=0).stop 2023-10-14T11:22:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.621+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 msgr2=0x7fb9200c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.621+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb90800e9b0 tx=0x7fb90800ecc0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 shutdown_connections 2023-10-14T11:22:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb9200b1250 0x7fb92014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb92006b3b0 0x7fb92015bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb90006af00 0x7fb90006d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 --2- 172.21.15.67:0/839711587 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb9200b0bb0 0x7fb9200c8100 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 >> 172.21.15.67:0/839711587 conn(0x7fb9200d04b0 msgr2=0x7fb9201e63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.622+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 shutdown_connections 2023-10-14T11:22:58.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.623+0000 7fb926641700 1 -- 172.21.15.67:0/839711587 wait complete. 2023-10-14T11:22:58.628 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T11:22:58.648 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:58.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.776+0000 7f0800420700 1 Processor -- start 2023-10-14T11:22:58.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.776+0000 7f0800420700 1 -- start start 2023-10-14T11:22:58.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.777+0000 7f0800420700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07f80c5be0 0x7f07f806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.777+0000 7f0800420700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 0x7f07f8071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.777+0000 7f0800420700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f815de40 con 0x7f07f815da60 2023-10-14T11:22:58.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.777+0000 7f0800420700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f81624b0 con 0x7f07f80c5be0 2023-10-14T11:22:58.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.777+0000 7f0800420700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f81616f0 con 0x7f07f806adc0 2023-10-14T11:22:58.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07f80c5be0 0x7f07f806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f07f80c5be0 0x7f07f806a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41170/0 (socket says 172.21.15.67:41170) 2023-10-14T11:22:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 -- 172.21.15.67:0/912171817 learned_addr learned my addr 172.21.15.67:0/912171817 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fe9bd700 1 --2- 172.21.15.67:0/912171817 >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 0x7f07f8071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 -- 172.21.15.67:0/912171817 >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 msgr2=0x7f07f8071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 --2- 172.21.15.67:0/912171817 >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 0x7f07f8071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 -- 172.21.15.67:0/912171817 >> v1:172.21.15.72:6789/0 conn(0x7f07f815da60 legacy=0x7f07f80c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 -- 172.21.15.67:0/912171817 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f81619d0 con 0x7f07f80c5be0 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fe9bd700 1 --2- 172.21.15.67:0/912171817 >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 0x7f07f8071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd9bb700 1 --2- 172.21.15.67:0/912171817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f80c5be0 0x7f07f806a880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f80b6530 tx=0x7f07f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d6e388ce8ffe7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd1ba700 1 -- 172.21.15.67:0/912171817 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400b870 con 0x7f07f80c5be0 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd1ba700 1 -- 172.21.15.67:0/912171817 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400b9d0 con 0x7f07f80c5be0 2023-10-14T11:22:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.778+0000 7f07fd1ba700 1 -- 172.21.15.67:0/912171817 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400bd60 con 0x7f07f80c5be0 2023-10-14T11:22:58.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 -- 172.21.15.67:0/912171817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f80c5be0 msgr2=0x7f07f806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 --2- 172.21.15.67:0/912171817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f80c5be0 0x7f07f806a880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f07f80b6530 tx=0x7f07f4009bd0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 -- 172.21.15.67:0/912171817 shutdown_connections 2023-10-14T11:22:58.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 --2- 172.21.15.67:0/912171817 >> v2:172.21.15.72:3300/0 conn(0x7f07f806adc0 0x7f07f8071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 --2- 172.21.15.67:0/912171817 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f80c5be0 0x7f07f806a880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 -- 172.21.15.67:0/912171817 >> 172.21.15.67:0/912171817 conn(0x7f07f80d0440 msgr2=0x7f07f80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:58.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 -- 172.21.15.67:0/912171817 shutdown_connections 2023-10-14T11:22:58.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.779+0000 7f0800420700 1 -- 172.21.15.67:0/912171817 wait complete. 2023-10-14T11:22:58.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.780+0000 7f0800420700 1 Processor -- start 2023-10-14T11:22:58.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.780+0000 7f0800420700 1 -- start start 2023-10-14T11:22:58.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07f806adc0 0x7f07f80b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07f80c5be0 0x7f07f813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f80b6210 con 0x7f07f815da60 2023-10-14T11:22:58.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f813d9a0 con 0x7f07f806adc0 2023-10-14T11:22:58.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f0800420700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f814e050 con 0x7f07f80c5be0 2023-10-14T11:22:58.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41178/0 (socket says 172.21.15.67:41178) 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 -- 172.21.15.67:0/794258311 learned_addr learned my addr 172.21.15.67:0/794258311 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fd9bb700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07f80c5be0 0x7f07f813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe1bc700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07f806adc0 0x7f07f80b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 -- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07f80c5be0 msgr2=0x7f07f813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07f80c5be0 0x7f07f813dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 -- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07f806adc0 msgr2=0x7f07f80b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07f806adc0 0x7f07f80b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 -- 172.21.15.67:0/794258311 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009550 con 0x7f07f815da60 2023-10-14T11:22:58.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.781+0000 7f07fe9bd700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07f0007df0 tx=0x7f07f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:58.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.782+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f000dd20 con 0x7f07f815da60 2023-10-14T11:22:58.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.782+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f000f040 con 0x7f07f815da60 2023-10-14T11:22:58.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.782+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0003c60 con 0x7f07f815da60 2023-10-14T11:22:58.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.782+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f80c7ad0 con 0x7f07f815da60 2023-10-14T11:22:58.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.782+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f815f4c0 con 0x7f07f815da60 2023-10-14T11:22:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.783+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f804ebb0 con 0x7f07f815da60 2023-10-14T11:22:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.783+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07f0004030 con 0x7f07f815da60 2023-10-14T11:22:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.784+0000 7f07eeffd700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 0x7f07dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.784+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07f0089560 con 0x7f07f815da60 2023-10-14T11:22:58.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.784+0000 7f07fe1bc700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 0x7f07dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:58.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.784+0000 7f07fe1bc700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 0x7f07dc06d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07e8007fd0 tx=0x7f07e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:58.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.788+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07f0054760 con 0x7f07f815da60 2023-10-14T11:22:58.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.989+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07f80ca7d0 con 0x7f07f815da60 2023-10-14T11:22:58.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.990+0000 7f07eeffd700 1 -- 172.21.15.67:0/794258311 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16458 (secure 0 0 0) 0x7f07f0057d80 con 0x7f07f815da60 2023-10-14T11:22:58.993 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:58.993 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:58.003143+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:58.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 msgr2=0x7f07dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 0x7f07dc06d3c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07e8007fd0 tx=0x7f07e8009040 comp rx=0 tx=0).stop 2023-10-14T11:22:58.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 msgr2=0x7f07f813e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:58.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07f0007df0 tx=0x7f07f000d3b0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 shutdown_connections 2023-10-14T11:22:58.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07dc06af00 0x7f07dc06d3c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07f815da60 0x7f07f813e170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07f806adc0 0x7f07f80b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 --2- 172.21.15.67:0/794258311 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07f80c5be0 0x7f07f813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 >> 172.21.15.67:0/794258311 conn(0x7f07f80d0440 msgr2=0x7f07f8158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:58.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 shutdown_connections 2023-10-14T11:22:58.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:58.992+0000 7f0800420700 1 -- 172.21.15.67:0/794258311 wait complete. 2023-10-14T11:22:59.008 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:22:59.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.130+0000 7fa8d1d76700 1 Processor -- start 2023-10-14T11:22:59.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.130+0000 7fa8d1d76700 1 -- start start 2023-10-14T11:22:59.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8d1d76700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8cc15da60 0x7fa8cc0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8d1d76700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8cc06af90 0x7fa8cc071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8d1d76700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0c5e70 con 0x7fa8cc0c5a10 2023-10-14T11:22:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8d1d76700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc1624b0 con 0x7fa8cc15da60 2023-10-14T11:22:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8d1d76700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc15de40 con 0x7fa8cc06af90 2023-10-14T11:22:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8cc15da60 0x7fa8cc0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa8cc15da60 0x7fa8cc0c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41182/0 (socket says 172.21.15.67:41182) 2023-10-14T11:22:59.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8caffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa8cc0c5a10 0x7fa8cc06a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40478/0 (socket says 172.21.15.67:40478) 2023-10-14T11:22:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 -- 172.21.15.67:0/3026615970 learned_addr learned my addr 172.21.15.67:0/3026615970 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cbfff700 1 --2- 172.21.15.67:0/3026615970 >> v2:172.21.15.72:3300/0 conn(0x7fa8cc06af90 0x7fa8cc071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 -- 172.21.15.67:0/3026615970 >> v2:172.21.15.72:3300/0 conn(0x7fa8cc06af90 msgr2=0x7fa8cc071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 --2- 172.21.15.67:0/3026615970 >> v2:172.21.15.72:3300/0 conn(0x7fa8cc06af90 0x7fa8cc071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 -- 172.21.15.67:0/3026615970 >> v1:172.21.15.67:6789/0 conn(0x7fa8cc0c5a10 legacy=0x7fa8cc06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 -- 172.21.15.67:0/3026615970 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc1616f0 con 0x7fa8cc15da60 2023-10-14T11:22:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8ca7fc700 1 -- 172.21.15.67:0/3026615970 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473008441 0 0) 0x7fa8cc0c5e70 con 0x7fa8cc0c5a10 2023-10-14T11:22:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.131+0000 7fa8cb7fe700 1 --2- 172.21.15.67:0/3026615970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0c54d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0cce70 tx=0x7fa8b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aef31612f7346a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8ca7fc700 1 -- 172.21.15.67:0/3026615970 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400b870 con 0x7fa8cc15da60 2023-10-14T11:22:59.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8ca7fc700 1 -- 172.21.15.67:0/3026615970 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b400b9d0 con 0x7fa8cc15da60 2023-10-14T11:22:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8ca7fc700 1 -- 172.21.15.67:0/3026615970 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400bd60 con 0x7fa8cc15da60 2023-10-14T11:22:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 -- 172.21.15.67:0/3026615970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 msgr2=0x7fa8cc0c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/3026615970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0c54d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc0cce70 tx=0x7fa8b4009bd0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 -- 172.21.15.67:0/3026615970 shutdown_connections 2023-10-14T11:22:59.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/3026615970 >> v2:172.21.15.72:3300/0 conn(0x7fa8cc06af90 0x7fa8cc071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/3026615970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0c54d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 -- 172.21.15.67:0/3026615970 >> 172.21.15.67:0/3026615970 conn(0x7fa8cc0d0440 msgr2=0x7fa8cc0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:59.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 -- 172.21.15.67:0/3026615970 shutdown_connections 2023-10-14T11:22:59.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.132+0000 7fa8d1d76700 1 -- 172.21.15.67:0/3026615970 wait complete. 2023-10-14T11:22:59.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.133+0000 7fa8d1d76700 1 Processor -- start 2023-10-14T11:22:59.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 -- start start 2023-10-14T11:22:59.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8cc06af90 0x7fa8cc1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8cc0c5a10 0x7fa8cc151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b5d30 con 0x7fa8cc15da60 2023-10-14T11:22:59.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1f71e0 con 0x7fa8cc0c5a10 2023-10-14T11:22:59.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8d1d76700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc152170 con 0x7fa8cc06af90 2023-10-14T11:22:59.150 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8cbfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8cbfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41192/0 (socket says 172.21.15.67:41192) 2023-10-14T11:22:59.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8cbfff700 1 -- 172.21.15.67:0/1896755838 learned_addr learned my addr 172.21.15.67:0/1896755838 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:59.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8caffd700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8cc0c5a10 0x7fa8cc151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.134+0000 7fa8cb7fe700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8cc06af90 0x7fa8cc1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 -- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8cc06af90 msgr2=0x7fa8cc1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8cc06af90 0x7fa8cc1f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 -- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8cc0c5a10 msgr2=0x7fa8cc151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8cc0c5a10 0x7fa8cc151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 -- 172.21.15.67:0/1896755838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009550 con 0x7fa8cc15da60 2023-10-14T11:22:59.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8cbfff700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4007e60 tx=0x7fa8c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c400ed30 con 0x7fa8cc15da60 2023-10-14T11:22:59.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4014420 con 0x7fa8cc15da60 2023-10-14T11:22:59.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40147d0 con 0x7fa8cc15da60 2023-10-14T11:22:59.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0b4e60 con 0x7fa8cc15da60 2023-10-14T11:22:59.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.135+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc0b5390 con 0x7fa8cc15da60 2023-10-14T11:22:59.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.136+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc04ebb0 con 0x7fa8cc15da60 2023-10-14T11:22:59.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.136+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa8c4014930 con 0x7fa8cc15da60 2023-10-14T11:22:59.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.137+0000 7fa8c3fff700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 0x7fa8ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.137+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8c4089af0 con 0x7fa8cc15da60 2023-10-14T11:22:59.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.137+0000 7fa8cb7fe700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 0x7fa8ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.138+0000 7fa8cb7fe700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 0x7fa8ac06d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4000c00 tx=0x7fa8b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.142+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8c4054c30 con 0x7fa8cc15da60 2023-10-14T11:22:59.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.342+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8cc0ce520 con 0x7fa8cc15da60 2023-10-14T11:22:59.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.343+0000 7fa8c3fff700 1 -- 172.21.15.67:0/1896755838 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16458 (secure 0 0 0) 0x7fa8c4058250 con 0x7fa8cc15da60 2023-10-14T11:22:59.346 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:22:59.346 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":20,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:58.003143+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:22:59.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 msgr2=0x7fa8ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 0x7fa8ac06d3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4000c00 tx=0x7fa8b4008030 comp rx=0 tx=0).stop 2023-10-14T11:22:59.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 msgr2=0x7fa8cc0720e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4007e60 tx=0x7fa8c400e3c0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 shutdown_connections 2023-10-14T11:22:59.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa8ac06af00 0x7fa8ac06d3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa8cc15da60 0x7fa8cc0720e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa8cc06af90 0x7fa8cc1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 --2- 172.21.15.67:0/1896755838 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8cc0c5a10 0x7fa8cc151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 >> 172.21.15.67:0/1896755838 conn(0x7fa8cc0d0440 msgr2=0x7fa8cc158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:59.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 shutdown_connections 2023-10-14T11:22:59.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.346+0000 7fa8d1d76700 1 -- 172.21.15.67:0/1896755838 wait complete. 2023-10-14T11:22:59.360 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T11:22:59.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.486+0000 7f4680a4d700 1 Processor -- start 2023-10-14T11:22:59.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.486+0000 7f4680a4d700 1 -- start start 2023-10-14T11:22:59.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4680a4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4680a4d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f467c0b6f70 0x7f467c0cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4680a4d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c15bbb0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4680a4d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0d0460 con 0x7f467c0b6f70 2023-10-14T11:22:59.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4680a4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0cc520 con 0x7f467c15b7d0 2023-10-14T11:22:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f467c0b6f70 0x7f467c0cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467ad9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f467c0cc0e0 0x7f467c0d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40494/0 (socket says 172.21.15.67:40494) 2023-10-14T11:22:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f467c0b6f70 0x7f467c0cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41198/0 (socket says 172.21.15.67:41198) 2023-10-14T11:22:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467ad9d700 1 -- 172.21.15.67:0/2767994086 learned_addr learned my addr 172.21.15.67:0/2767994086 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:22:59.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467a59c700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 -- 172.21.15.67:0/2767994086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 msgr2=0x7f467c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:22:59.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 -- 172.21.15.67:0/2767994086 >> v1:172.21.15.67:6789/0 conn(0x7f467c0cc0e0 legacy=0x7f467c0d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 -- 172.21.15.67:0/2767994086 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0cf6a0 con 0x7f467c0b6f70 2023-10-14T11:22:59.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467a59c700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:22:59.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f4679d9b700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0b6f70 0x7f467c0cbba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4670009840 tx=0x7f4670009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf75232ee914ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467959a700 1 -- 172.21.15.67:0/2767994086 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670011830 con 0x7f467c0b6f70 2023-10-14T11:22:59.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467959a700 1 -- 172.21.15.67:0/2767994086 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670011990 con 0x7f467c0b6f70 2023-10-14T11:22:59.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.487+0000 7f467959a700 1 -- 172.21.15.67:0/2767994086 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670011d20 con 0x7f467c0b6f70 2023-10-14T11:22:59.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 -- 172.21.15.67:0/2767994086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0b6f70 msgr2=0x7f467c0cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0b6f70 0x7f467c0cbba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4670009840 tx=0x7f4670009b50 comp rx=0 tx=0).stop 2023-10-14T11:22:59.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 -- 172.21.15.67:0/2767994086 shutdown_connections 2023-10-14T11:22:59.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2767994086 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0b6f70 0x7f467c0cbba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 -- 172.21.15.67:0/2767994086 >> 172.21.15.67:0/2767994086 conn(0x7f467c0665a0 msgr2=0x7f467c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:22:59.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 -- 172.21.15.67:0/2767994086 shutdown_connections 2023-10-14T11:22:59.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.488+0000 7f4680a4d700 1 -- 172.21.15.67:0/2767994086 wait complete. 2023-10-14T11:22:59.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.490+0000 7f4680a4d700 1 Processor -- start 2023-10-14T11:22:59.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.490+0000 7f4680a4d700 1 -- start start 2023-10-14T11:22:59.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 0x7f467c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c8b20 con 0x7f467c0cc0e0 2023-10-14T11:22:59.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c153d30 con 0x7f467c0b6f70 2023-10-14T11:22:59.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4680a4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c154010 con 0x7f467c15b7d0 2023-10-14T11:22:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41204/0 (socket says 172.21.15.67:41204) 2023-10-14T11:22:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 -- 172.21.15.67:0/2059241755 learned_addr learned my addr 172.21.15.67:0/2059241755 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:22:59.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f467ad9d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f467a59c700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 0x7f467c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 -- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 msgr2=0x7f467c0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 -- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 msgr2=0x7f467c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:22:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 0x7f467c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:22:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 -- 172.21.15.67:0/2059241755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700094a0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f467a59c700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 0x7f467c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:22:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.491+0000 7f4679d9b700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4670000c00 tx=0x7f4670004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.492+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700036a0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.492+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467001e070 con 0x7f467c0cc0e0 2023-10-14T11:22:59.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.492+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670003a60 con 0x7f467c0cc0e0 2023-10-14T11:22:59.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.492+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c1542f0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.492+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c153a30 con 0x7f467c0cc0e0 2023-10-14T11:22:59.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.493+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c0c8c90 con 0x7f467c0cc0e0 2023-10-14T11:22:59.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.493+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4670003bc0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.493+0000 7f466affd700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 0x7f465c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:22:59.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.494+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f467008a6f0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.494+0000 7f467a59c700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 0x7f465c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:22:59.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.494+0000 7f467a59c700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 0x7f465c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f466c009a60 tx=0x7f466c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:22:59.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.498+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46700557a0 con 0x7f467c0cc0e0 2023-10-14T11:22:59.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:22:59.752+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f467c04ebb0 con 0x7f467c0cc0e0 2023-10-14T11:23:00.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.621+0000 7f466affd700 1 -- 172.21.15.67:0/2059241755 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46700200b0 con 0x7f467c0cc0e0 2023-10-14T11:23:00.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 msgr2=0x7f465c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 0x7f465c06d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f466c009a60 tx=0x7f466c008040 comp rx=0 tx=0).stop 2023-10-14T11:23:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 msgr2=0x7f467c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4670000c00 tx=0x7f4670004750 comp rx=0 tx=0).stop 2023-10-14T11:23:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 shutdown_connections 2023-10-14T11:23:00.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f467c15b7d0 0x7f467c0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f467c0b6f70 0x7f467c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f465c06af00 0x7f465c06d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 --2- 172.21.15.67:0/2059241755 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f467c0cc0e0 0x7f467c0b2350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 >> 172.21.15.67:0/2059241755 conn(0x7f467c0665a0 msgr2=0x7f467c0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:00.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 shutdown_connections 2023-10-14T11:23:00.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.624+0000 7f4680a4d700 1 -- 172.21.15.67:0/2059241755 wait complete. 2023-10-14T11:23:00.642 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T11:23:00.642 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T11:23:00.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.775+0000 7f8888f3b700 1 Processor -- start 2023-10-14T11:23:00.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.775+0000 7f8888f3b700 1 -- start start 2023-10-14T11:23:00.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8888f3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f88840cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8888f3b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88840cf660 0x7f88841616f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8888f3b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840cd7d0 con 0x7f8884161c30 2023-10-14T11:23:00.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8888f3b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88840ccbb0 con 0x7f88840cf660 2023-10-14T11:23:00.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8888f3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88840ce350 con 0x7f888415e7e0 2023-10-14T11:23:00.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88840cf660 0x7f88841616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f88840cf660 0x7f88841616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41210/0 (socket says 172.21.15.67:41210) 2023-10-14T11:23:00.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8882d9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8884161c30 0x7f8884154130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40508/0 (socket says 172.21.15.67:40508) 2023-10-14T11:23:00.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 -- 172.21.15.67:0/328108204 learned_addr learned my addr 172.21.15.67:0/328108204 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:00.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f888259c700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f88840cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 -- 172.21.15.67:0/328108204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 msgr2=0x7f88840cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:00.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f88840cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 -- 172.21.15.67:0/328108204 >> v1:172.21.15.67:6789/0 conn(0x7f8884161c30 legacy=0x7f8884154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f888159a700 1 -- 172.21.15.67:0/328108204 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110293967 0 0) 0x7f88840cd7d0 con 0x7f8884161c30 2023-10-14T11:23:00.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 -- 172.21.15.67:0/328108204 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840cfae0 con 0x7f88840cf660 2023-10-14T11:23:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.776+0000 7f8881d9b700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f88841616f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88780098f0 tx=0x7f8878009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822dd6841607df3b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f888159a700 1 -- 172.21.15.67:0/328108204 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800b8a0 con 0x7f88840cf660 2023-10-14T11:23:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f888159a700 1 -- 172.21.15.67:0/328108204 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800ba00 con 0x7f88840cf660 2023-10-14T11:23:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f888159a700 1 -- 172.21.15.67:0/328108204 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800bd90 con 0x7f88840cf660 2023-10-14T11:23:00.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 -- 172.21.15.67:0/328108204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 msgr2=0x7f88841616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f88841616f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88780098f0 tx=0x7f8878009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 -- 172.21.15.67:0/328108204 shutdown_connections 2023-10-14T11:23:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f88840cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 --2- 172.21.15.67:0/328108204 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f88841616f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 -- 172.21.15.67:0/328108204 >> 172.21.15.67:0/328108204 conn(0x7f88840665a0 msgr2=0x7f8884066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 -- 172.21.15.67:0/328108204 shutdown_connections 2023-10-14T11:23:00.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.777+0000 7f8888f3b700 1 -- 172.21.15.67:0/328108204 wait complete. 2023-10-14T11:23:00.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.778+0000 7f8888f3b700 1 Processor -- start 2023-10-14T11:23:00.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 -- start start 2023-10-14T11:23:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f888414cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 0x7f88840c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888414c7c0 con 0x7f88840cf660 2023-10-14T11:23:00.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888414bb40 con 0x7f8884161c30 2023-10-14T11:23:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f8888f3b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888414be20 con 0x7f888415e7e0 2023-10-14T11:23:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f888259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f888259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41216/0 (socket says 172.21.15.67:41216) 2023-10-14T11:23:00.790 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.779+0000 7f888259c700 1 -- 172.21.15.67:0/3526598658 learned_addr learned my addr 172.21.15.67:0/3526598658 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8881d9b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f888414cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8882d9d700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 0x7f88840c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 -- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 msgr2=0x7f888414cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f888414cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 -- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 msgr2=0x7f88840c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 0x7f88840c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 -- 172.21.15.67:0/3526598658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878009550 con 0x7f88840cf660 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8882d9d700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 0x7f88840c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8881d9b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f888414cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f888259c700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f887400c7f0 tx=0x7f887400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:00.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874011800 con 0x7f88840cf660 2023-10-14T11:23:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874011960 con 0x7f88840cf660 2023-10-14T11:23:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888414c100 con 0x7f88840cf660 2023-10-14T11:23:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874011cf0 con 0x7f88840cf660 2023-10-14T11:23:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.780+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888414e500 con 0x7f88840cf660 2023-10-14T11:23:00.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.781+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88840b7560 con 0x7f88840cf660 2023-10-14T11:23:00.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.782+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8874018360 con 0x7f88840cf660 2023-10-14T11:23:00.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.782+0000 7f8872ffd700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 0x7f886406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:00.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.782+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88740895c0 con 0x7f88840cf660 2023-10-14T11:23:00.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.782+0000 7f8881d9b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 0x7f886406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:00.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.783+0000 7f8881d9b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 0x7f886406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8878014040 tx=0x7f8878008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:00.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:00.787+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8874054680 con 0x7f88840cf660 2023-10-14T11:23:01.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.033+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f888404ebb0 con 0x7f88840cf660 2023-10-14T11:23:01.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.623+0000 7f8872ffd700 1 -- 172.21.15.67:0/3526598658 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8874057ca0 con 0x7f88840cf660 2023-10-14T11:23:01.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 msgr2=0x7f886406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 0x7f886406d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8878014040 tx=0x7f8878008030 comp rx=0 tx=0).stop 2023-10-14T11:23:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 msgr2=0x7f888414dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f887400c7f0 tx=0x7f887400cbb0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 shutdown_connections 2023-10-14T11:23:01.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8884161c30 0x7f88840c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f886406af00 0x7f886406d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f88840cf660 0x7f888414dfc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 --2- 172.21.15.67:0/3526598658 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f888415e7e0 0x7f888414cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 >> 172.21.15.67:0/3526598658 conn(0x7f88840665a0 msgr2=0x7f888406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:01.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 shutdown_connections 2023-10-14T11:23:01.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.626+0000 7f8888f3b700 1 -- 172.21.15.67:0/3526598658 wait complete. 2023-10-14T11:23:01.642 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T11:23:01.643 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:01.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.770+0000 7ff1942e8700 1 Processor -- start 2023-10-14T11:23:01.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.770+0000 7ff1942e8700 1 -- start start 2023-10-14T11:23:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff18c0ceb30 0x7ff18c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff18c0cdc30 0x7ff18c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0cffe0 0x7ff18c0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0cef10 con 0x7ff18c0ceb30 2023-10-14T11:23:01.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0d2090 con 0x7ff18c0cdc30 2023-10-14T11:23:01.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff1942e8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15deb0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff18c0ceb30 0x7ff18c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff18c0ceb30 0x7ff18c0b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41224/0 (socket says 172.21.15.67:41224) 2023-10-14T11:23:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 -- 172.21.15.67:0/1978356732 learned_addr learned my addr 172.21.15.67:0/1978356732 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192885700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0cffe0 0x7ff18c0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff191883700 1 --2- 172.21.15.67:0/1978356732 >> v2:172.21.15.72:3300/0 conn(0x7ff18c0cdc30 0x7ff18c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 -- 172.21.15.67:0/1978356732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0cffe0 msgr2=0x7ff18c0d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:01.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0cffe0 0x7ff18c0d03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 -- 172.21.15.67:0/1978356732 >> v2:172.21.15.72:3300/0 conn(0x7ff18c0cdc30 msgr2=0x7ff18c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:01.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.771+0000 7ff192084700 1 --2- 172.21.15.67:0/1978356732 >> v2:172.21.15.72:3300/0 conn(0x7ff18c0cdc30 0x7ff18c0cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff192084700 1 -- 172.21.15.67:0/1978356732 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0d22e0 con 0x7ff18c0ceb30 2023-10-14T11:23:01.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff192084700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0ceb30 0x7ff18c0b04c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff18c072be0 tx=0x7ff17c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68920364f1f35db4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:01.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff191082700 1 -- 172.21.15.67:0/1978356732 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00b870 con 0x7ff18c0ceb30 2023-10-14T11:23:01.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff191082700 1 -- 172.21.15.67:0/1978356732 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00b9d0 con 0x7ff18c0ceb30 2023-10-14T11:23:01.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff191082700 1 -- 172.21.15.67:0/1978356732 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00bd60 con 0x7ff18c0ceb30 2023-10-14T11:23:01.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 -- 172.21.15.67:0/1978356732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0ceb30 msgr2=0x7ff18c0b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:01.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0ceb30 0x7ff18c0b04c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff18c072be0 tx=0x7ff17c009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 -- 172.21.15.67:0/1978356732 shutdown_connections 2023-10-14T11:23:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0cffe0 0x7ff18c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 --2- 172.21.15.67:0/1978356732 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0ceb30 0x7ff18c0b04c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 --2- 172.21.15.67:0/1978356732 >> v2:172.21.15.72:3300/0 conn(0x7ff18c0cdc30 0x7ff18c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.772+0000 7ff1942e8700 1 -- 172.21.15.67:0/1978356732 >> 172.21.15.67:0/1978356732 conn(0x7ff18c0d1570 msgr2=0x7ff18c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:01.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.773+0000 7ff1942e8700 1 -- 172.21.15.67:0/1978356732 shutdown_connections 2023-10-14T11:23:01.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.773+0000 7ff1942e8700 1 -- 172.21.15.67:0/1978356732 wait complete. 2023-10-14T11:23:01.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.774+0000 7ff1942e8700 1 Processor -- start 2023-10-14T11:23:01.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.774+0000 7ff1942e8700 1 -- start start 2023-10-14T11:23:01.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.774+0000 7ff1942e8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff18c0cdc30 0x7ff18c0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.774+0000 7ff1942e8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0ceb30 0x7ff18c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.774+0000 7ff1942e8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff1942e8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c63d0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff1942e8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c6a50 con 0x7ff18c0cdc30 2023-10-14T11:23:01.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff1942e8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0c6d30 con 0x7ff18c0ceb30 2023-10-14T11:23:01.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41234/0 (socket says 172.21.15.67:41234) 2023-10-14T11:23:01.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192084700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff18c0cdc30 0x7ff18c0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 -- 172.21.15.67:0/2933336120 learned_addr learned my addr 172.21.15.67:0/2933336120 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:01.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff191883700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0ceb30 0x7ff18c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 -- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0ceb30 msgr2=0x7ff18c14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:01.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0ceb30 0x7ff18c14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 -- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff18c0cdc30 msgr2=0x7ff18c0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:01.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff18c0cdc30 0x7ff18c0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:01.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 -- 172.21.15.67:0/2933336120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009550 con 0x7ff18c0cffe0 2023-10-14T11:23:01.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff192885700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff18400cc30 tx=0x7ff18400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:01.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18400aa50 con 0x7ff18c0cffe0 2023-10-14T11:23:01.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18400abb0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c0c7010 con 0x7ff18c0cffe0 2023-10-14T11:23:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184003a20 con 0x7ff18c0cffe0 2023-10-14T11:23:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.775+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c0c75d0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.776+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c04ebb0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.777+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff18400f3f0 con 0x7ff18c0cffe0 2023-10-14T11:23:01.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.777+0000 7ff182ffd700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 0x7ff17006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:01.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.777+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff184089610 con 0x7ff18c0cffe0 2023-10-14T11:23:01.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.777+0000 7ff192084700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 0x7ff17006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:01.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.778+0000 7ff192084700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 0x7ff17006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff17c014040 tx=0x7ff17c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:01.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:01.782+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1840546c0 con 0x7ff18c0cffe0 2023-10-14T11:23:02.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.027+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff18c067320 con 0x7ff18c0cffe0 2023-10-14T11:23:02.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.028+0000 7ff182ffd700 1 -- 172.21.15.67:0/2933336120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff18401d090 con 0x7ff18c0cffe0 2023-10-14T11:23:02.030 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:02.031 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:02.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 msgr2=0x7ff17006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 0x7ff17006d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff17c014040 tx=0x7ff17c008030 comp rx=0 tx=0).stop 2023-10-14T11:23:02.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 msgr2=0x7ff18c0b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff18400cc30 tx=0x7ff18400cf40 comp rx=0 tx=0).stop 2023-10-14T11:23:02.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 shutdown_connections 2023-10-14T11:23:02.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff17006af30 0x7ff17006d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff18c0cffe0 0x7ff18c0b6af0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff18c0cdc30 0x7ff18c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 --2- 172.21.15.67:0/2933336120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff18c0ceb30 0x7ff18c14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 >> 172.21.15.67:0/2933336120 conn(0x7ff18c0d1570 msgr2=0x7ff18c15c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 shutdown_connections 2023-10-14T11:23:02.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.030+0000 7ff1942e8700 1 -- 172.21.15.67:0/2933336120 wait complete. 2023-10-14T11:23:02.035 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:02.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:02.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.167+0000 7fe76bea8700 1 Processor -- start 2023-10-14T11:23:02.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.167+0000 7fe76bea8700 1 -- start start 2023-10-14T11:23:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe76415da60 0x7fe7640c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7640c5a10 0x7fe76406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe76406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7641624b0 con 0x7fe76415da60 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640c5e70 con 0x7fe7640c5a10 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe76bea8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415de40 con 0x7fe76406adc0 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe769c44700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe76415da60 0x7fe7640c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe769c44700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe76415da60 0x7fe7640c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41238/0 (socket says 172.21.15.67:41238) 2023-10-14T11:23:02.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.168+0000 7fe769c44700 1 -- 172.21.15.67:0/3202142118 learned_addr learned my addr 172.21.15.67:0/3202142118 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769443700 1 --2- 172.21.15.67:0/3202142118 >> v2:172.21.15.72:3300/0 conn(0x7fe7640c5a10 0x7fe76406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe76a445700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe76406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 -- 172.21.15.67:0/3202142118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 msgr2=0x7fe76406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe76406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 -- 172.21.15.67:0/3202142118 >> v2:172.21.15.72:3300/0 conn(0x7fe7640c5a10 msgr2=0x7fe76406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 --2- 172.21.15.67:0/3202142118 >> v2:172.21.15.72:3300/0 conn(0x7fe7640c5a10 0x7fe76406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 -- 172.21.15.67:0/3202142118 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7641616f0 con 0x7fe76415da60 2023-10-14T11:23:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe769c44700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640c54d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe7640afab0 tx=0x7fe754009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e1b65c9b90ba7f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe768c42700 1 -- 172.21.15.67:0/3202142118 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011830 con 0x7fe76415da60 2023-10-14T11:23:02.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe768c42700 1 -- 172.21.15.67:0/3202142118 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754011990 con 0x7fe76415da60 2023-10-14T11:23:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.169+0000 7fe768c42700 1 -- 172.21.15.67:0/3202142118 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011d20 con 0x7fe76415da60 2023-10-14T11:23:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 -- 172.21.15.67:0/3202142118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 msgr2=0x7fe7640c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640c54d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe7640afab0 tx=0x7fe754009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 -- 172.21.15.67:0/3202142118 shutdown_connections 2023-10-14T11:23:02.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe76406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 --2- 172.21.15.67:0/3202142118 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640c54d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 --2- 172.21.15.67:0/3202142118 >> v2:172.21.15.72:3300/0 conn(0x7fe7640c5a10 0x7fe76406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 -- 172.21.15.67:0/3202142118 >> 172.21.15.67:0/3202142118 conn(0x7fe7640d0440 msgr2=0x7fe7640d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 -- 172.21.15.67:0/3202142118 shutdown_connections 2023-10-14T11:23:02.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.170+0000 7fe76bea8700 1 -- 172.21.15.67:0/3202142118 wait complete. 2023-10-14T11:23:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.171+0000 7fe76bea8700 1 Processor -- start 2023-10-14T11:23:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.171+0000 7fe76bea8700 1 -- start start 2023-10-14T11:23:02.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe7641f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 0x7fe7640ce650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640ad280 con 0x7fe76415da60 2023-10-14T11:23:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415ff10 con 0x7fe7640c5a10 2023-10-14T11:23:02.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76bea8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641601f0 con 0x7fe76406adc0 2023-10-14T11:23:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41246/0 (socket says 172.21.15.67:41246) 2023-10-14T11:23:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 -- 172.21.15.67:0/589410107 learned_addr learned my addr 172.21.15.67:0/589410107 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe769c44700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe7641f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe769443700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 0x7fe7640ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 -- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 msgr2=0x7fe7641f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe7641f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 -- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 msgr2=0x7fe7640ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 0x7fe7640ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 -- 172.21.15.67:0/589410107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009550 con 0x7fe76415da60 2023-10-14T11:23:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe769c44700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe7641f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe769443700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 0x7fe7640ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe76a445700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00eed0 tx=0x7fe75c00b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.172+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c010040 con 0x7fe76415da60 2023-10-14T11:23:02.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.173+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c00bb70 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.173+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7641604d0 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.173+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c014400 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.173+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe764160a90 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.174+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764160cb0 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.174+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe75c014560 con 0x7fe76415da60 2023-10-14T11:23:02.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.174+0000 7fe75a7fc700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 0x7fe74806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.174+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe75c089d60 con 0x7fe76415da60 2023-10-14T11:23:02.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.174+0000 7fe769c44700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 0x7fe74806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.175+0000 7fe769c44700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 0x7fe74806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7540098f0 tx=0x7fe754008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.179+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe75c054e10 con 0x7fe76415da60 2023-10-14T11:23:02.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.379+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe76404ebb0 con 0x7fe76415da60 2023-10-14T11:23:02.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.381+0000 7fe75a7fc700 1 -- 172.21.15.67:0/589410107 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe75c018090 con 0x7fe76415da60 2023-10-14T11:23:02.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:02.383 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 msgr2=0x7fe74806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 0x7fe74806d3c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7540098f0 tx=0x7fe754008030 comp rx=0 tx=0).stop 2023-10-14T11:23:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 msgr2=0x7fe7640ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00eed0 tx=0x7fe75c00b0b0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 shutdown_connections 2023-10-14T11:23:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe74806af00 0x7fe74806d3c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe76415da60 0x7fe7640ceb90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe76406adc0 0x7fe7641f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 --2- 172.21.15.67:0/589410107 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7640c5a10 0x7fe7640ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 >> 172.21.15.67:0/589410107 conn(0x7fe7640d0440 msgr2=0x7fe7640720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 shutdown_connections 2023-10-14T11:23:02.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.383+0000 7fe76bea8700 1 -- 172.21.15.67:0/589410107 wait complete. 2023-10-14T11:23:02.397 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T11:23:02.398 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:02.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.520+0000 7f70e9da7700 1 Processor -- start 2023-10-14T11:23:02.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.520+0000 7f70e9da7700 1 -- start start 2023-10-14T11:23:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e9da7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e40c5be0 0x7f70e406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e9da7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70e406adc0 0x7f70e4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e9da7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e415de40 con 0x7f70e415da60 2023-10-14T11:23:02.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e9da7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e41624b0 con 0x7f70e40c5be0 2023-10-14T11:23:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e9da7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e41616f0 con 0x7f70e406adc0 2023-10-14T11:23:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e2ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e40c5be0 0x7f70e406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e2ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70e40c5be0 0x7f70e406a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41250/0 (socket says 172.21.15.67:41250) 2023-10-14T11:23:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e2ffd700 1 -- 172.21.15.67:0/2221786614 learned_addr learned my addr 172.21.15.67:0/2221786614 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e2ffd700 1 -- 172.21.15.67:0/2221786614 >> v2:172.21.15.72:3300/0 conn(0x7f70e406adc0 msgr2=0x7f70e4071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.521+0000 7f70e3fff700 1 --2- 172.21.15.67:0/2221786614 >> v2:172.21.15.72:3300/0 conn(0x7f70e406adc0 0x7f70e4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e2ffd700 1 --2- 172.21.15.67:0/2221786614 >> v2:172.21.15.72:3300/0 conn(0x7f70e406adc0 0x7f70e4071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e2ffd700 1 -- 172.21.15.67:0/2221786614 >> v1:172.21.15.72:6789/0 conn(0x7f70e415da60 legacy=0x7f70e40c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e2ffd700 1 -- 172.21.15.67:0/2221786614 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e41619d0 con 0x7f70e40c5be0 2023-10-14T11:23:02.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e2ffd700 1 --2- 172.21.15.67:0/2221786614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e40c5be0 0x7f70e406a880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b6530 tx=0x7f70cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693de22f16a322c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e27fc700 1 -- 172.21.15.67:0/2221786614 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc004230 con 0x7f70e40c5be0 2023-10-14T11:23:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e27fc700 1 -- 172.21.15.67:0/2221786614 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc004390 con 0x7f70e40c5be0 2023-10-14T11:23:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e27fc700 1 -- 172.21.15.67:0/2221786614 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0036a0 con 0x7f70e40c5be0 2023-10-14T11:23:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 -- 172.21.15.67:0/2221786614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e40c5be0 msgr2=0x7f70e406a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 --2- 172.21.15.67:0/2221786614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e40c5be0 0x7f70e406a880 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b6530 tx=0x7f70cc009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 -- 172.21.15.67:0/2221786614 shutdown_connections 2023-10-14T11:23:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 --2- 172.21.15.67:0/2221786614 >> v2:172.21.15.72:3300/0 conn(0x7f70e406adc0 0x7f70e4071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 --2- 172.21.15.67:0/2221786614 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e40c5be0 0x7f70e406a880 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 -- 172.21.15.67:0/2221786614 >> 172.21.15.67:0/2221786614 conn(0x7f70e40d0440 msgr2=0x7f70e40d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 -- 172.21.15.67:0/2221786614 shutdown_connections 2023-10-14T11:23:02.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.522+0000 7f70e9da7700 1 -- 172.21.15.67:0/2221786614 wait complete. 2023-10-14T11:23:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.524+0000 7f70e9da7700 1 Processor -- start 2023-10-14T11:23:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.524+0000 7f70e9da7700 1 -- start start 2023-10-14T11:23:02.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.524+0000 7f70e9da7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406adc0 0x7f70e415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.524+0000 7f70e9da7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e40c5be0 0x7f70e41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.524+0000 7f70e9da7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e9da7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4154520 con 0x7f70e415da60 2023-10-14T11:23:02.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e9da7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4160440 con 0x7f70e40c5be0 2023-10-14T11:23:02.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e9da7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e41525c0 con 0x7f70e406adc0 2023-10-14T11:23:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41258/0 (socket says 172.21.15.67:41258) 2023-10-14T11:23:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 -- 172.21.15.67:0/3998219130 learned_addr learned my addr 172.21.15.67:0/3998219130 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e2ffd700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e40c5be0 0x7f70e41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e37fe700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406adc0 0x7f70e415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 -- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406adc0 msgr2=0x7f70e415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406adc0 0x7f70e415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 -- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e40c5be0 msgr2=0x7f70e41531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e40c5be0 0x7f70e41531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 -- 172.21.15.67:0/3998219130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc009550 con 0x7f70e415da60 2023-10-14T11:23:02.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e3fff700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00cc30 tx=0x7f70dc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc00aa50 con 0x7f70e415da60 2023-10-14T11:23:02.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc00abb0 con 0x7f70e415da60 2023-10-14T11:23:02.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e415f830 con 0x7f70e415da60 2023-10-14T11:23:02.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc003a20 con 0x7f70e415da60 2023-10-14T11:23:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.525+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e415fdf0 con 0x7f70e415da60 2023-10-14T11:23:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.526+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e41605b0 con 0x7f70e415da60 2023-10-14T11:23:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.527+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70dc00f3f0 con 0x7f70e415da60 2023-10-14T11:23:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.527+0000 7f70dbfff700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 0x7f70c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.527+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70dc0896b0 con 0x7f70e415da60 2023-10-14T11:23:02.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.527+0000 7f70e37fe700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 0x7f70c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.528+0000 7f70e37fe700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 0x7f70c406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b2020 tx=0x7f70d4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.532+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70dc054760 con 0x7f70e415da60 2023-10-14T11:23:02.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.730+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70e4161f90 con 0x7f70c406af00 2023-10-14T11:23:02.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.739+0000 7f70dbfff700 1 -- 172.21.15.67:0/3998219130 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264658 (secure 0 0 0) 0x7f70d4003cf0 con 0x7f70c406af00 2023-10-14T11:23:02.744 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:02.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 msgr2=0x7f70c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 0x7f70c406d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70e40b2020 tx=0x7f70d4007ec0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 msgr2=0x7f70e4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00cc30 tx=0x7f70dc00cf40 comp rx=0 tx=0).stop 2023-10-14T11:23:02.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 shutdown_connections 2023-10-14T11:23:02.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70c406af00 0x7f70c406d3c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70e415da60 0x7f70e4152080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70e406adc0 0x7f70e415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 --2- 172.21.15.67:0/3998219130 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70e40c5be0 0x7f70e41531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 >> 172.21.15.67:0/3998219130 conn(0x7f70e40d0440 msgr2=0x7f70e406fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 shutdown_connections 2023-10-14T11:23:02.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.742+0000 7f70e9da7700 1 -- 172.21.15.67:0/3998219130 wait complete. 2023-10-14T11:23:02.749 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:02.756 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T11:23:02.401374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.812595"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427431+0000","last_change":"2023-10-14T11:22:58.633786+0000","last_active":"2023-10-14T11:23:00.427431+0000","last_peered":"2023-10-14T11:23:00.427431+0000","last_clean":"2023-10-14T11:23:00.427431+0000","last_became_active":"2023-10-14T11:22:58.633501+0000","last_became_peered":"2023-10-14T11:22:58.633501+0000","last_unstale":"2023-10-14T11:23:00.427431+0000","last_undegraded":"2023-10-14T11:23:00.427431+0000","last_fullsized":"2023-10-14T11:23:00.427431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:23.198990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618109+0000","last_change":"2023-10-14T11:22:58.622868+0000","last_active":"2023-10-14T11:22:59.618109+0000","last_peered":"2023-10-14T11:22:59.618109+0000","last_clean":"2023-10-14T11:22:59.618109+0000","last_became_active":"2023-10-14T11:22:58.622234+0000","last_became_peered":"2023-10-14T11:22:58.622234+0000","last_unstale":"2023-10-14T11:22:59.618109+0000","last_undegraded":"2023-10-14T11:22:59.618109+0000","last_fullsized":"2023-10-14T11:22:59.618109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203623+0000","last_change":"2023-10-14T11:22:58.624332+0000","last_active":"2023-10-14T11:23:00.203623+0000","last_peered":"2023-10-14T11:23:00.203623+0000","last_clean":"2023-10-14T11:23:00.203623+0000","last_became_active":"2023-10-14T11:22:58.623983+0000","last_became_peered":"2023-10-14T11:22:58.623983+0000","last_unstale":"2023-10-14T11:23:00.203623+0000","last_undegraded":"2023-10-14T11:23:00.203623+0000","last_fullsized":"2023-10-14T11:23:00.203623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618466+0000","last_change":"2023-10-14T11:22:58.633546+0000","last_active":"2023-10-14T11:22:59.618466+0000","last_peered":"2023-10-14T11:22:59.618466+0000","last_clean":"2023-10-14T11:22:59.618466+0000","last_became_active":"2023-10-14T11:22:58.632591+0000","last_became_peered":"2023-10-14T11:22:58.632591+0000","last_unstale":"2023-10-14T11:22:59.618466+0000","last_undegraded":"2023-10-14T11:22:59.618466+0000","last_fullsized":"2023-10-14T11:22:59.618466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427014+0000","last_change":"2023-10-14T11:22:58.625368+0000","last_active":"2023-10-14T11:23:00.427014+0000","last_peered":"2023-10-14T11:23:00.427014+0000","last_clean":"2023-10-14T11:23:00.427014+0000","last_became_active":"2023-10-14T11:22:58.622784+0000","last_became_peered":"2023-10-14T11:22:58.622784+0000","last_unstale":"2023-10-14T11:23:00.427014+0000","last_undegraded":"2023-10-14T11:23:00.427014+0000","last_fullsized":"2023-10-14T11:23:00.427014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617901+0000","last_change":"2023-10-14T11:22:58.639055+0000","last_active":"2023-10-14T11:22:59.617901+0000","last_peered":"2023-10-14T11:22:59.617901+0000","last_clean":"2023-10-14T11:22:59.617901+0000","last_became_active":"2023-10-14T11:22:58.638778+0000","last_became_peered":"2023-10-14T11:22:58.638778+0000","last_unstale":"2023-10-14T11:22:59.617901+0000","last_undegraded":"2023-10-14T11:22:59.617901+0000","last_fullsized":"2023-10-14T11:22:59.617901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426896+0000","last_change":"2023-10-14T11:22:58.627430+0000","last_active":"2023-10-14T11:23:00.426896+0000","last_peered":"2023-10-14T11:23:00.426896+0000","last_clean":"2023-10-14T11:23:00.426896+0000","last_became_active":"2023-10-14T11:22:58.621813+0000","last_became_peered":"2023-10-14T11:22:58.621813+0000","last_unstale":"2023-10-14T11:23:00.426896+0000","last_undegraded":"2023-10-14T11:23:00.426896+0000","last_fullsized":"2023-10-14T11:23:00.426896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426617+0000","last_change":"2023-10-14T11:22:58.634733+0000","last_active":"2023-10-14T11:23:00.426617+0000","last_peered":"2023-10-14T11:23:00.426617+0000","last_clean":"2023-10-14T11:23:00.426617+0000","last_became_active":"2023-10-14T11:22:58.634207+0000","last_became_peered":"2023-10-14T11:22:58.634207+0000","last_unstale":"2023-10-14T11:23:00.426617+0000","last_undegraded":"2023-10-14T11:23:00.426617+0000","last_fullsized":"2023-10-14T11:23:00.426617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427274+0000","last_change":"2023-10-14T11:22:58.637875+0000","last_active":"2023-10-14T11:23:00.427274+0000","last_peered":"2023-10-14T11:23:00.427274+0000","last_clean":"2023-10-14T11:23:00.427274+0000","last_became_active":"2023-10-14T11:22:58.637706+0000","last_became_peered":"2023-10-14T11:22:58.637706+0000","last_unstale":"2023-10-14T11:23:00.427274+0000","last_undegraded":"2023-10-14T11:23:00.427274+0000","last_fullsized":"2023-10-14T11:23:00.427274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:02:14.102087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619647+0000","last_change":"2023-10-14T11:22:58.632598+0000","last_active":"2023-10-14T11:22:59.619647+0000","last_peered":"2023-10-14T11:22:59.619647+0000","last_clean":"2023-10-14T11:22:59.619647+0000","last_became_active":"2023-10-14T11:22:58.632159+0000","last_became_peered":"2023-10-14T11:22:58.632159+0000","last_unstale":"2023-10-14T11:22:59.619647+0000","last_undegraded":"2023-10-14T11:22:59.619647+0000","last_fullsized":"2023-10-14T11:22:59.619647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619162+0000","last_change":"2023-10-14T11:22:58.635248+0000","last_active":"2023-10-14T11:22:59.619162+0000","last_peered":"2023-10-14T11:22:59.619162+0000","last_clean":"2023-10-14T11:22:59.619162+0000","last_became_active":"2023-10-14T11:22:58.634992+0000","last_became_peered":"2023-10-14T11:22:58.634992+0000","last_unstale":"2023-10-14T11:22:59.619162+0000","last_undegraded":"2023-10-14T11:22:59.619162+0000","last_fullsized":"2023-10-14T11:22:59.619162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919307+0000","last_change":"2023-10-14T11:22:58.624511+0000","last_active":"2023-10-14T11:22:59.919307+0000","last_peered":"2023-10-14T11:22:59.919307+0000","last_clean":"2023-10-14T11:22:59.919307+0000","last_became_active":"2023-10-14T11:22:58.623795+0000","last_became_peered":"2023-10-14T11:22:58.623795+0000","last_unstale":"2023-10-14T11:22:59.919307+0000","last_undegraded":"2023-10-14T11:22:59.919307+0000","last_fullsized":"2023-10-14T11:22:59.919307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:00.651862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427131+0000","last_change":"2023-10-14T11:22:58.620085+0000","last_active":"2023-10-14T11:23:00.427131+0000","last_peered":"2023-10-14T11:23:00.427131+0000","last_clean":"2023-10-14T11:23:00.427131+0000","last_became_active":"2023-10-14T11:22:58.619466+0000","last_became_peered":"2023-10-14T11:22:58.619466+0000","last_unstale":"2023-10-14T11:23:00.427131+0000","last_undegraded":"2023-10-14T11:23:00.427131+0000","last_fullsized":"2023-10-14T11:23:00.427131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203570+0000","last_change":"2023-10-14T11:22:58.618541+0000","last_active":"2023-10-14T11:23:00.203570+0000","last_peered":"2023-10-14T11:23:00.203570+0000","last_clean":"2023-10-14T11:23:00.203570+0000","last_became_active":"2023-10-14T11:22:58.618206+0000","last_became_peered":"2023-10-14T11:22:58.618206+0000","last_unstale":"2023-10-14T11:23:00.203570+0000","last_undegraded":"2023-10-14T11:23:00.203570+0000","last_fullsized":"2023-10-14T11:23:00.203570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617739+0000","last_change":"2023-10-14T11:22:58.625071+0000","last_active":"2023-10-14T11:22:59.617739+0000","last_peered":"2023-10-14T11:22:59.617739+0000","last_clean":"2023-10-14T11:22:59.617739+0000","last_became_active":"2023-10-14T11:22:58.624786+0000","last_became_peered":"2023-10-14T11:22:58.624786+0000","last_unstale":"2023-10-14T11:22:59.617739+0000","last_undegraded":"2023-10-14T11:22:59.617739+0000","last_fullsized":"2023-10-14T11:22:59.617739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617746+0000","last_change":"2023-10-14T11:22:58.632587+0000","last_active":"2023-10-14T11:22:59.617746+0000","last_peered":"2023-10-14T11:22:59.617746+0000","last_clean":"2023-10-14T11:22:59.617746+0000","last_became_active":"2023-10-14T11:22:58.631338+0000","last_became_peered":"2023-10-14T11:22:58.631338+0000","last_unstale":"2023-10-14T11:22:59.617746+0000","last_undegraded":"2023-10-14T11:22:59.617746+0000","last_fullsized":"2023-10-14T11:22:59.617746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618293+0000","last_change":"2023-10-14T11:22:58.637286+0000","last_active":"2023-10-14T11:22:59.618293+0000","last_peered":"2023-10-14T11:22:59.618293+0000","last_clean":"2023-10-14T11:22:59.618293+0000","last_became_active":"2023-10-14T11:22:58.636987+0000","last_became_peered":"2023-10-14T11:22:58.636987+0000","last_unstale":"2023-10-14T11:22:59.618293+0000","last_undegraded":"2023-10-14T11:22:59.618293+0000","last_fullsized":"2023-10-14T11:22:59.618293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427284+0000","last_change":"2023-10-14T11:22:58.627520+0000","last_active":"2023-10-14T11:23:00.427284+0000","last_peered":"2023-10-14T11:23:00.427284+0000","last_clean":"2023-10-14T11:23:00.427284+0000","last_became_active":"2023-10-14T11:22:58.627210+0000","last_became_peered":"2023-10-14T11:22:58.627210+0000","last_unstale":"2023-10-14T11:23:00.427284+0000","last_undegraded":"2023-10-14T11:23:00.427284+0000","last_fullsized":"2023-10-14T11:23:00.427284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427097+0000","last_change":"2023-10-14T11:22:58.625306+0000","last_active":"2023-10-14T11:23:00.427097+0000","last_peered":"2023-10-14T11:23:00.427097+0000","last_clean":"2023-10-14T11:23:00.427097+0000","last_became_active":"2023-10-14T11:22:58.625026+0000","last_became_peered":"2023-10-14T11:22:58.625026+0000","last_unstale":"2023-10-14T11:23:00.427097+0000","last_undegraded":"2023-10-14T11:23:00.427097+0000","last_fullsized":"2023-10-14T11:23:00.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203594+0000","last_change":"2023-10-14T11:22:57.606379+0000","last_active":"2023-10-14T11:23:00.203594+0000","last_peered":"2023-10-14T11:23:00.203594+0000","last_clean":"2023-10-14T11:23:00.203594+0000","last_became_active":"2023-10-14T11:22:57.606084+0000","last_became_peered":"2023-10-14T11:22:57.606084+0000","last_unstale":"2023-10-14T11:23:00.203594+0000","last_undegraded":"2023-10-14T11:23:00.203594+0000","last_fullsized":"2023-10-14T11:23:00.203594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:46.618392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427389+0000","last_change":"2023-10-14T11:22:58.617985+0000","last_active":"2023-10-14T11:23:00.427389+0000","last_peered":"2023-10-14T11:23:00.427389+0000","last_clean":"2023-10-14T11:23:00.427389+0000","last_became_active":"2023-10-14T11:22:58.617671+0000","last_became_peered":"2023-10-14T11:22:58.617671+0000","last_unstale":"2023-10-14T11:23:00.427389+0000","last_undegraded":"2023-10-14T11:23:00.427389+0000","last_fullsized":"2023-10-14T11:23:00.427389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427061+0000","last_change":"2023-10-14T11:22:57.606838+0000","last_active":"2023-10-14T11:23:00.427061+0000","last_peered":"2023-10-14T11:23:00.427061+0000","last_clean":"2023-10-14T11:23:00.427061+0000","last_became_active":"2023-10-14T11:22:57.606525+0000","last_became_peered":"2023-10-14T11:22:57.606525+0000","last_unstale":"2023-10-14T11:23:00.427061+0000","last_undegraded":"2023-10-14T11:23:00.427061+0000","last_fullsized":"2023-10-14T11:23:00.427061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203773+0000","last_change":"2023-10-14T11:22:58.635376+0000","last_active":"2023-10-14T11:23:00.203773+0000","last_peered":"2023-10-14T11:23:00.203773+0000","last_clean":"2023-10-14T11:23:00.203773+0000","last_became_active":"2023-10-14T11:22:58.635055+0000","last_became_peered":"2023-10-14T11:22:58.635055+0000","last_unstale":"2023-10-14T11:23:00.203773+0000","last_undegraded":"2023-10-14T11:23:00.203773+0000","last_fullsized":"2023-10-14T11:23:00.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427311+0000","last_change":"2023-10-14T11:22:57.606462+0000","last_active":"2023-10-14T11:23:00.427311+0000","last_peered":"2023-10-14T11:23:00.427311+0000","last_clean":"2023-10-14T11:23:00.427311+0000","last_became_active":"2023-10-14T11:22:57.606205+0000","last_became_peered":"2023-10-14T11:22:57.606205+0000","last_unstale":"2023-10-14T11:23:00.427311+0000","last_undegraded":"2023-10-14T11:23:00.427311+0000","last_fullsized":"2023-10-14T11:23:00.427311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619693+0000","last_change":"2023-10-14T11:22:58.634078+0000","last_active":"2023-10-14T11:22:59.619693+0000","last_peered":"2023-10-14T11:22:59.619693+0000","last_clean":"2023-10-14T11:22:59.619693+0000","last_became_active":"2023-10-14T11:22:58.633808+0000","last_became_peered":"2023-10-14T11:22:58.633808+0000","last_unstale":"2023-10-14T11:22:59.619693+0000","last_undegraded":"2023-10-14T11:22:59.619693+0000","last_fullsized":"2023-10-14T11:22:59.619693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426936+0000","last_change":"2023-10-14T11:22:57.608295+0000","last_active":"2023-10-14T11:23:00.426936+0000","last_peered":"2023-10-14T11:23:00.426936+0000","last_clean":"2023-10-14T11:23:00.426936+0000","last_became_active":"2023-10-14T11:22:57.607972+0000","last_became_peered":"2023-10-14T11:22:57.607972+0000","last_unstale":"2023-10-14T11:23:00.426936+0000","last_undegraded":"2023-10-14T11:23:00.426936+0000","last_fullsized":"2023-10-14T11:23:00.426936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:33.504370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618196+0000","last_change":"2023-10-14T11:22:58.633471+0000","last_active":"2023-10-14T11:22:59.618196+0000","last_peered":"2023-10-14T11:22:59.618196+0000","last_clean":"2023-10-14T11:22:59.618196+0000","last_became_active":"2023-10-14T11:22:58.633175+0000","last_became_peered":"2023-10-14T11:22:58.633175+0000","last_unstale":"2023-10-14T11:22:59.618196+0000","last_undegraded":"2023-10-14T11:22:59.618196+0000","last_fullsized":"2023-10-14T11:22:59.618196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427053+0000","last_change":"2023-10-14T11:22:57.608273+0000","last_active":"2023-10-14T11:23:00.427053+0000","last_peered":"2023-10-14T11:23:00.427053+0000","last_clean":"2023-10-14T11:23:00.427053+0000","last_became_active":"2023-10-14T11:22:57.607043+0000","last_became_peered":"2023-10-14T11:22:57.607043+0000","last_unstale":"2023-10-14T11:23:00.427053+0000","last_undegraded":"2023-10-14T11:23:00.427053+0000","last_fullsized":"2023-10-14T11:23:00.427053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918907+0000","last_change":"2023-10-14T11:22:58.618099+0000","last_active":"2023-10-14T11:22:59.918907+0000","last_peered":"2023-10-14T11:22:59.918907+0000","last_clean":"2023-10-14T11:22:59.918907+0000","last_became_active":"2023-10-14T11:22:58.617688+0000","last_became_peered":"2023-10-14T11:22:58.617688+0000","last_unstale":"2023-10-14T11:22:59.918907+0000","last_undegraded":"2023-10-14T11:22:59.918907+0000","last_fullsized":"2023-10-14T11:22:59.918907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:15.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619036+0000","last_change":"2023-10-14T11:22:57.596557+0000","last_active":"2023-10-14T11:22:59.619036+0000","last_peered":"2023-10-14T11:22:59.619036+0000","last_clean":"2023-10-14T11:22:59.619036+0000","last_became_active":"2023-10-14T11:22:57.596258+0000","last_became_peered":"2023-10-14T11:22:57.596258+0000","last_unstale":"2023-10-14T11:22:59.619036+0000","last_undegraded":"2023-10-14T11:22:59.619036+0000","last_fullsized":"2023-10-14T11:22:59.619036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203763+0000","last_change":"2023-10-14T11:22:58.624416+0000","last_active":"2023-10-14T11:23:00.203763+0000","last_peered":"2023-10-14T11:23:00.203763+0000","last_clean":"2023-10-14T11:23:00.203763+0000","last_became_active":"2023-10-14T11:22:58.624136+0000","last_became_peered":"2023-10-14T11:22:58.624136+0000","last_unstale":"2023-10-14T11:23:00.203763+0000","last_undegraded":"2023-10-14T11:23:00.203763+0000","last_fullsized":"2023-10-14T11:23:00.203763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426746+0000","last_change":"2023-10-14T11:22:57.607548+0000","last_active":"2023-10-14T11:23:00.426746+0000","last_peered":"2023-10-14T11:23:00.426746+0000","last_clean":"2023-10-14T11:23:00.426746+0000","last_became_active":"2023-10-14T11:22:57.607266+0000","last_became_peered":"2023-10-14T11:22:57.607266+0000","last_unstale":"2023-10-14T11:23:00.426746+0000","last_undegraded":"2023-10-14T11:23:00.426746+0000","last_fullsized":"2023-10-14T11:23:00.426746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427490+0000","last_change":"2023-10-14T11:22:58.627962+0000","last_active":"2023-10-14T11:23:00.427490+0000","last_peered":"2023-10-14T11:23:00.427490+0000","last_clean":"2023-10-14T11:23:00.427490+0000","last_became_active":"2023-10-14T11:22:58.627647+0000","last_became_peered":"2023-10-14T11:22:58.627647+0000","last_unstale":"2023-10-14T11:23:00.427490+0000","last_undegraded":"2023-10-14T11:23:00.427490+0000","last_fullsized":"2023-10-14T11:23:00.427490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618403+0000","last_change":"2023-10-14T11:22:57.601447+0000","last_active":"2023-10-14T11:22:59.618403+0000","last_peered":"2023-10-14T11:22:59.618403+0000","last_clean":"2023-10-14T11:22:59.618403+0000","last_became_active":"2023-10-14T11:22:57.601160+0000","last_became_peered":"2023-10-14T11:22:57.601160+0000","last_unstale":"2023-10-14T11:22:59.618403+0000","last_undegraded":"2023-10-14T11:22:59.618403+0000","last_fullsized":"2023-10-14T11:22:59.618403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617889+0000","last_change":"2023-10-14T11:22:58.619189+0000","last_active":"2023-10-14T11:22:59.617889+0000","last_peered":"2023-10-14T11:22:59.617889+0000","last_clean":"2023-10-14T11:22:59.617889+0000","last_became_active":"2023-10-14T11:22:58.618873+0000","last_became_peered":"2023-10-14T11:22:58.618873+0000","last_unstale":"2023-10-14T11:22:59.617889+0000","last_undegraded":"2023-10-14T11:22:59.617889+0000","last_fullsized":"2023-10-14T11:22:59.617889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619790+0000","last_change":"2023-10-14T11:22:57.601166+0000","last_active":"2023-10-14T11:22:59.619790+0000","last_peered":"2023-10-14T11:22:59.619790+0000","last_clean":"2023-10-14T11:22:59.619790+0000","last_became_active":"2023-10-14T11:22:57.600664+0000","last_became_peered":"2023-10-14T11:22:57.600664+0000","last_unstale":"2023-10-14T11:22:59.619790+0000","last_undegraded":"2023-10-14T11:22:59.619790+0000","last_fullsized":"2023-10-14T11:22:59.619790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618932+0000","last_change":"2023-10-14T11:22:58.638814+0000","last_active":"2023-10-14T11:22:59.618932+0000","last_peered":"2023-10-14T11:22:59.618932+0000","last_clean":"2023-10-14T11:22:59.618932+0000","last_became_active":"2023-10-14T11:22:58.638511+0000","last_became_peered":"2023-10-14T11:22:58.638511+0000","last_unstale":"2023-10-14T11:22:59.618932+0000","last_undegraded":"2023-10-14T11:22:59.618932+0000","last_fullsized":"2023-10-14T11:22:59.618932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618785+0000","last_change":"2023-10-14T11:22:57.605185+0000","last_active":"2023-10-14T11:22:59.618785+0000","last_peered":"2023-10-14T11:22:59.618785+0000","last_clean":"2023-10-14T11:22:59.618785+0000","last_became_active":"2023-10-14T11:22:57.604882+0000","last_became_peered":"2023-10-14T11:22:57.604882+0000","last_unstale":"2023-10-14T11:22:59.618785+0000","last_undegraded":"2023-10-14T11:22:59.618785+0000","last_fullsized":"2023-10-14T11:22:59.618785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:09.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203726+0000","last_change":"2023-10-14T11:22:58.635766+0000","last_active":"2023-10-14T11:23:00.203726+0000","last_peered":"2023-10-14T11:23:00.203726+0000","last_clean":"2023-10-14T11:23:00.203726+0000","last_became_active":"2023-10-14T11:22:58.635066+0000","last_became_peered":"2023-10-14T11:22:58.635066+0000","last_unstale":"2023-10-14T11:23:00.203726+0000","last_undegraded":"2023-10-14T11:23:00.203726+0000","last_fullsized":"2023-10-14T11:23:00.203726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617960+0000","last_change":"2023-10-14T11:22:57.604629+0000","last_active":"2023-10-14T11:22:59.617960+0000","last_peered":"2023-10-14T11:22:59.617960+0000","last_clean":"2023-10-14T11:22:59.617960+0000","last_became_active":"2023-10-14T11:22:57.604227+0000","last_became_peered":"2023-10-14T11:22:57.604227+0000","last_unstale":"2023-10-14T11:22:59.617960+0000","last_undegraded":"2023-10-14T11:22:59.617960+0000","last_fullsized":"2023-10-14T11:22:59.617960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919288+0000","last_change":"2023-10-14T11:22:58.624704+0000","last_active":"2023-10-14T11:22:59.919288+0000","last_peered":"2023-10-14T11:22:59.919288+0000","last_clean":"2023-10-14T11:22:59.919288+0000","last_became_active":"2023-10-14T11:22:58.624178+0000","last_became_peered":"2023-10-14T11:22:58.624178+0000","last_unstale":"2023-10-14T11:22:59.919288+0000","last_undegraded":"2023-10-14T11:22:59.919288+0000","last_fullsized":"2023-10-14T11:22:59.919288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619299+0000","last_change":"2023-10-14T11:22:57.611378+0000","last_active":"2023-10-14T11:22:59.619299+0000","last_peered":"2023-10-14T11:22:59.619299+0000","last_clean":"2023-10-14T11:22:59.619299+0000","last_became_active":"2023-10-14T11:22:57.611089+0000","last_became_peered":"2023-10-14T11:22:57.611089+0000","last_unstale":"2023-10-14T11:22:59.619299+0000","last_undegraded":"2023-10-14T11:22:59.619299+0000","last_fullsized":"2023-10-14T11:22:59.619299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427075+0000","last_change":"2023-10-14T11:22:58.625644+0000","last_active":"2023-10-14T11:23:00.427075+0000","last_peered":"2023-10-14T11:23:00.427075+0000","last_clean":"2023-10-14T11:23:00.427075+0000","last_became_active":"2023-10-14T11:22:58.621672+0000","last_became_peered":"2023-10-14T11:22:58.621672+0000","last_unstale":"2023-10-14T11:23:00.427075+0000","last_undegraded":"2023-10-14T11:23:00.427075+0000","last_fullsized":"2023-10-14T11:23:00.427075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203761+0000","last_change":"2023-10-14T11:22:57.595554+0000","last_active":"2023-10-14T11:23:00.203761+0000","last_peered":"2023-10-14T11:23:00.203761+0000","last_clean":"2023-10-14T11:23:00.203761+0000","last_became_active":"2023-10-14T11:22:57.595229+0000","last_became_peered":"2023-10-14T11:22:57.595229+0000","last_unstale":"2023-10-14T11:23:00.203761+0000","last_undegraded":"2023-10-14T11:23:00.203761+0000","last_fullsized":"2023-10-14T11:23:00.203761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203400+0000","last_change":"2023-10-14T11:22:58.617721+0000","last_active":"2023-10-14T11:23:00.203400+0000","last_peered":"2023-10-14T11:23:00.203400+0000","last_clean":"2023-10-14T11:23:00.203400+0000","last_became_active":"2023-10-14T11:22:58.617363+0000","last_became_peered":"2023-10-14T11:22:58.617363+0000","last_unstale":"2023-10-14T11:23:00.203400+0000","last_undegraded":"2023-10-14T11:23:00.203400+0000","last_fullsized":"2023-10-14T11:23:00.203400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:09.703756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618467+0000","last_change":"2023-10-14T11:22:57.607719+0000","last_active":"2023-10-14T11:22:59.618467+0000","last_peered":"2023-10-14T11:22:59.618467+0000","last_clean":"2023-10-14T11:22:59.618467+0000","last_became_active":"2023-10-14T11:22:57.607364+0000","last_became_peered":"2023-10-14T11:22:57.607364+0000","last_unstale":"2023-10-14T11:22:59.618467+0000","last_undegraded":"2023-10-14T11:22:59.618467+0000","last_fullsized":"2023-10-14T11:22:59.618467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427266+0000","last_change":"2023-10-14T11:22:58.634366+0000","last_active":"2023-10-14T11:23:00.427266+0000","last_peered":"2023-10-14T11:23:00.427266+0000","last_clean":"2023-10-14T11:23:00.427266+0000","last_became_active":"2023-10-14T11:22:58.634138+0000","last_became_peered":"2023-10-14T11:22:58.634138+0000","last_unstale":"2023-10-14T11:23:00.427266+0000","last_undegraded":"2023-10-14T11:23:00.427266+0000","last_fullsized":"2023-10-14T11:23:00.427266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619102+0000","last_change":"2023-10-14T11:22:57.597846+0000","last_active":"2023-10-14T11:22:59.619102+0000","last_peered":"2023-10-14T11:22:59.619102+0000","last_clean":"2023-10-14T11:22:59.619102+0000","last_became_active":"2023-10-14T11:22:57.597524+0000","last_became_peered":"2023-10-14T11:22:57.597524+0000","last_unstale":"2023-10-14T11:22:59.619102+0000","last_undegraded":"2023-10-14T11:22:59.619102+0000","last_fullsized":"2023-10-14T11:22:59.619102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619170+0000","last_change":"2023-10-14T11:22:58.616377+0000","last_active":"2023-10-14T11:22:59.619170+0000","last_peered":"2023-10-14T11:22:59.619170+0000","last_clean":"2023-10-14T11:22:59.619170+0000","last_became_active":"2023-10-14T11:22:58.616115+0000","last_became_peered":"2023-10-14T11:22:58.616115+0000","last_unstale":"2023-10-14T11:22:59.619170+0000","last_undegraded":"2023-10-14T11:22:59.619170+0000","last_fullsized":"2023-10-14T11:22:59.619170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426474+0000","last_change":"2023-10-14T11:22:57.604681+0000","last_active":"2023-10-14T11:23:00.426474+0000","last_peered":"2023-10-14T11:23:00.426474+0000","last_clean":"2023-10-14T11:23:00.426474+0000","last_became_active":"2023-10-14T11:22:57.604355+0000","last_became_peered":"2023-10-14T11:22:57.604355+0000","last_unstale":"2023-10-14T11:23:00.426474+0000","last_undegraded":"2023-10-14T11:23:00.426474+0000","last_fullsized":"2023-10-14T11:23:00.426474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426914+0000","last_change":"2023-10-14T11:22:58.633870+0000","last_active":"2023-10-14T11:23:00.426914+0000","last_peered":"2023-10-14T11:23:00.426914+0000","last_clean":"2023-10-14T11:23:00.426914+0000","last_became_active":"2023-10-14T11:22:58.633668+0000","last_became_peered":"2023-10-14T11:22:58.633668+0000","last_unstale":"2023-10-14T11:23:00.426914+0000","last_undegraded":"2023-10-14T11:23:00.426914+0000","last_fullsized":"2023-10-14T11:23:00.426914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919292+0000","last_change":"2023-10-14T11:22:57.596605+0000","last_active":"2023-10-14T11:22:59.919292+0000","last_peered":"2023-10-14T11:22:59.919292+0000","last_clean":"2023-10-14T11:22:59.919292+0000","last_became_active":"2023-10-14T11:22:57.596284+0000","last_became_peered":"2023-10-14T11:22:57.596284+0000","last_unstale":"2023-10-14T11:22:59.919292+0000","last_undegraded":"2023-10-14T11:22:59.919292+0000","last_fullsized":"2023-10-14T11:22:59.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427249+0000","last_change":"2023-10-14T11:22:58.628154+0000","last_active":"2023-10-14T11:23:00.427249+0000","last_peered":"2023-10-14T11:23:00.427249+0000","last_clean":"2023-10-14T11:23:00.427249+0000","last_became_active":"2023-10-14T11:22:58.627867+0000","last_became_peered":"2023-10-14T11:22:58.627867+0000","last_unstale":"2023-10-14T11:23:00.427249+0000","last_undegraded":"2023-10-14T11:23:00.427249+0000","last_fullsized":"2023-10-14T11:23:00.427249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617938+0000","last_change":"2023-10-14T11:22:57.603369+0000","last_active":"2023-10-14T11:22:59.617938+0000","last_peered":"2023-10-14T11:22:59.617938+0000","last_clean":"2023-10-14T11:22:59.617938+0000","last_became_active":"2023-10-14T11:22:57.603018+0000","last_became_peered":"2023-10-14T11:22:57.603018+0000","last_unstale":"2023-10-14T11:22:59.617938+0000","last_undegraded":"2023-10-14T11:22:59.617938+0000","last_fullsized":"2023-10-14T11:22:59.617938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618471+0000","last_change":"2023-10-14T11:22:58.631463+0000","last_active":"2023-10-14T11:22:59.618471+0000","last_peered":"2023-10-14T11:22:59.618471+0000","last_clean":"2023-10-14T11:22:59.618471+0000","last_became_active":"2023-10-14T11:22:58.630763+0000","last_became_peered":"2023-10-14T11:22:58.630763+0000","last_unstale":"2023-10-14T11:22:59.618471+0000","last_undegraded":"2023-10-14T11:22:59.618471+0000","last_fullsized":"2023-10-14T11:22:59.618471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618387+0000","last_change":"2023-10-14T11:22:57.604539+0000","last_active":"2023-10-14T11:22:59.618387+0000","last_peered":"2023-10-14T11:22:59.618387+0000","last_clean":"2023-10-14T11:22:59.618387+0000","last_became_active":"2023-10-14T11:22:57.604263+0000","last_became_peered":"2023-10-14T11:22:57.604263+0000","last_unstale":"2023-10-14T11:22:59.618387+0000","last_undegraded":"2023-10-14T11:22:59.618387+0000","last_fullsized":"2023-10-14T11:22:59.618387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919024+0000","last_change":"2023-10-14T11:22:58.632118+0000","last_active":"2023-10-14T11:22:59.919024+0000","last_peered":"2023-10-14T11:22:59.919024+0000","last_clean":"2023-10-14T11:22:59.919024+0000","last_became_active":"2023-10-14T11:22:58.631651+0000","last_became_peered":"2023-10-14T11:22:58.631651+0000","last_unstale":"2023-10-14T11:22:59.919024+0000","last_undegraded":"2023-10-14T11:22:59.919024+0000","last_fullsized":"2023-10-14T11:22:59.919024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617780+0000","last_change":"2023-10-14T11:22:58.622493+0000","last_active":"2023-10-14T11:22:59.617780+0000","last_peered":"2023-10-14T11:22:59.617780+0000","last_clean":"2023-10-14T11:22:59.617780+0000","last_became_active":"2023-10-14T11:22:58.622121+0000","last_became_peered":"2023-10-14T11:22:58.622121+0000","last_unstale":"2023-10-14T11:22:59.617780+0000","last_undegraded":"2023-10-14T11:22:59.617780+0000","last_fullsized":"2023-10-14T11:22:59.617780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426598+0000","last_change":"2023-10-14T11:22:57.607846+0000","last_active":"2023-10-14T11:23:00.426598+0000","last_peered":"2023-10-14T11:23:00.426598+0000","last_clean":"2023-10-14T11:23:00.426598+0000","last_became_active":"2023-10-14T11:22:57.607545+0000","last_became_peered":"2023-10-14T11:22:57.607545+0000","last_unstale":"2023-10-14T11:23:00.426598+0000","last_undegraded":"2023-10-14T11:23:00.426598+0000","last_fullsized":"2023-10-14T11:23:00.426598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426906+0000","last_change":"2023-10-14T11:22:58.634690+0000","last_active":"2023-10-14T11:23:00.426906+0000","last_peered":"2023-10-14T11:23:00.426906+0000","last_clean":"2023-10-14T11:23:00.426906+0000","last_became_active":"2023-10-14T11:22:58.634441+0000","last_became_peered":"2023-10-14T11:22:58.634441+0000","last_unstale":"2023-10-14T11:23:00.426906+0000","last_undegraded":"2023-10-14T11:23:00.426906+0000","last_fullsized":"2023-10-14T11:23:00.426906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617821+0000","last_change":"2023-10-14T11:22:57.606397+0000","last_active":"2023-10-14T11:22:59.617821+0000","last_peered":"2023-10-14T11:22:59.617821+0000","last_clean":"2023-10-14T11:22:59.617821+0000","last_became_active":"2023-10-14T11:22:57.606142+0000","last_became_peered":"2023-10-14T11:22:57.606142+0000","last_unstale":"2023-10-14T11:22:59.617821+0000","last_undegraded":"2023-10-14T11:22:59.617821+0000","last_fullsized":"2023-10-14T11:22:59.617821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T11:22:58.611333+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:22:58.611333+0000","last_peered":"2023-10-14T11:22:58.611333+0000","last_clean":"2023-10-14T11:22:58.611333+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:22:58.611333+0000","last_undegraded":"2023-10-14T11:22:58.611333+0000","last_fullsized":"2023-10-14T11:22:58.611333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203375+0000","last_change":"2023-10-14T11:22:58.619533+0000","last_active":"2023-10-14T11:23:00.203375+0000","last_peered":"2023-10-14T11:23:00.203375+0000","last_clean":"2023-10-14T11:23:00.203375+0000","last_became_active":"2023-10-14T11:22:58.618854+0000","last_became_peered":"2023-10-14T11:22:58.618854+0000","last_unstale":"2023-10-14T11:23:00.203375+0000","last_undegraded":"2023-10-14T11:23:00.203375+0000","last_fullsized":"2023-10-14T11:23:00.203375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:03.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426745+0000","last_change":"2023-10-14T11:22:57.611514+0000","last_active":"2023-10-14T11:23:00.426745+0000","last_peered":"2023-10-14T11:23:00.426745+0000","last_clean":"2023-10-14T11:23:00.426745+0000","last_became_active":"2023-10-14T11:22:57.611164+0000","last_became_peered":"2023-10-14T11:22:57.611164+0000","last_unstale":"2023-10-14T11:23:00.426745+0000","last_undegraded":"2023-10-14T11:23:00.426745+0000","last_fullsized":"2023-10-14T11:23:00.426745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427204+0000","last_change":"2023-10-14T11:22:57.605364+0000","last_active":"2023-10-14T11:23:00.427204+0000","last_peered":"2023-10-14T11:23:00.427204+0000","last_clean":"2023-10-14T11:23:00.427204+0000","last_became_active":"2023-10-14T11:22:57.605054+0000","last_became_peered":"2023-10-14T11:22:57.605054+0000","last_unstale":"2023-10-14T11:23:00.427204+0000","last_undegraded":"2023-10-14T11:23:00.427204+0000","last_fullsized":"2023-10-14T11:23:00.427204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617883+0000","last_change":"2023-10-14T11:22:58.622614+0000","last_active":"2023-10-14T11:22:59.617883+0000","last_peered":"2023-10-14T11:22:59.617883+0000","last_clean":"2023-10-14T11:22:59.617883+0000","last_became_active":"2023-10-14T11:22:58.622225+0000","last_became_peered":"2023-10-14T11:22:58.622225+0000","last_unstale":"2023-10-14T11:22:59.617883+0000","last_undegraded":"2023-10-14T11:22:59.617883+0000","last_fullsized":"2023-10-14T11:22:59.617883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617793+0000","last_change":"2023-10-14T11:22:57.604443+0000","last_active":"2023-10-14T11:22:59.617793+0000","last_peered":"2023-10-14T11:22:59.617793+0000","last_clean":"2023-10-14T11:22:59.617793+0000","last_became_active":"2023-10-14T11:22:57.604109+0000","last_became_peered":"2023-10-14T11:22:57.604109+0000","last_unstale":"2023-10-14T11:22:59.617793+0000","last_undegraded":"2023-10-14T11:22:59.617793+0000","last_fullsized":"2023-10-14T11:22:59.617793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427299+0000","last_change":"2023-10-14T11:22:58.619248+0000","last_active":"2023-10-14T11:23:00.427299+0000","last_peered":"2023-10-14T11:23:00.427299+0000","last_clean":"2023-10-14T11:23:00.427299+0000","last_became_active":"2023-10-14T11:22:58.618115+0000","last_became_peered":"2023-10-14T11:22:58.618115+0000","last_unstale":"2023-10-14T11:23:00.427299+0000","last_undegraded":"2023-10-14T11:23:00.427299+0000","last_fullsized":"2023-10-14T11:23:00.427299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619698+0000","last_change":"2023-10-14T11:22:57.606345+0000","last_active":"2023-10-14T11:22:59.619698+0000","last_peered":"2023-10-14T11:22:59.619698+0000","last_clean":"2023-10-14T11:22:59.619698+0000","last_became_active":"2023-10-14T11:22:57.606077+0000","last_became_peered":"2023-10-14T11:22:57.606077+0000","last_unstale":"2023-10-14T11:22:59.619698+0000","last_undegraded":"2023-10-14T11:22:59.619698+0000","last_fullsized":"2023-10-14T11:22:59.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203626+0000","last_change":"2023-10-14T11:22:58.619914+0000","last_active":"2023-10-14T11:23:00.203626+0000","last_peered":"2023-10-14T11:23:00.203626+0000","last_clean":"2023-10-14T11:23:00.203626+0000","last_became_active":"2023-10-14T11:22:58.619545+0000","last_became_peered":"2023-10-14T11:22:58.619545+0000","last_unstale":"2023-10-14T11:23:00.203626+0000","last_undegraded":"2023-10-14T11:23:00.203626+0000","last_fullsized":"2023-10-14T11:23:00.203626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426640+0000","last_change":"2023-10-14T11:22:57.606954+0000","last_active":"2023-10-14T11:23:00.426640+0000","last_peered":"2023-10-14T11:23:00.426640+0000","last_clean":"2023-10-14T11:23:00.426640+0000","last_became_active":"2023-10-14T11:22:57.606659+0000","last_became_peered":"2023-10-14T11:22:57.606659+0000","last_unstale":"2023-10-14T11:23:00.426640+0000","last_undegraded":"2023-10-14T11:23:00.426640+0000","last_fullsized":"2023-10-14T11:23:00.426640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918996+0000","last_change":"2023-10-14T11:22:58.622532+0000","last_active":"2023-10-14T11:22:59.918996+0000","last_peered":"2023-10-14T11:22:59.918996+0000","last_clean":"2023-10-14T11:22:59.918996+0000","last_became_active":"2023-10-14T11:22:58.622238+0000","last_became_peered":"2023-10-14T11:22:58.622238+0000","last_unstale":"2023-10-14T11:22:59.918996+0000","last_undegraded":"2023-10-14T11:22:59.918996+0000","last_fullsized":"2023-10-14T11:22:59.918996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:04.332572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617982+0000","last_change":"2023-10-14T11:22:57.608859+0000","last_active":"2023-10-14T11:22:59.617982+0000","last_peered":"2023-10-14T11:22:59.617982+0000","last_clean":"2023-10-14T11:22:59.617982+0000","last_became_active":"2023-10-14T11:22:57.608589+0000","last_became_peered":"2023-10-14T11:22:57.608589+0000","last_unstale":"2023-10-14T11:22:59.617982+0000","last_undegraded":"2023-10-14T11:22:59.617982+0000","last_fullsized":"2023-10-14T11:22:59.617982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426871+0000","last_change":"2023-10-14T11:22:58.616287+0000","last_active":"2023-10-14T11:23:00.426871+0000","last_peered":"2023-10-14T11:23:00.426871+0000","last_clean":"2023-10-14T11:23:00.426871+0000","last_became_active":"2023-10-14T11:22:58.615925+0000","last_became_peered":"2023-10-14T11:22:58.615925+0000","last_unstale":"2023-10-14T11:23:00.426871+0000","last_undegraded":"2023-10-14T11:23:00.426871+0000","last_fullsized":"2023-10-14T11:23:00.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618069+0000","last_change":"2023-10-14T11:22:57.611743+0000","last_active":"2023-10-14T11:22:59.618069+0000","last_peered":"2023-10-14T11:22:59.618069+0000","last_clean":"2023-10-14T11:22:59.618069+0000","last_became_active":"2023-10-14T11:22:57.611456+0000","last_became_peered":"2023-10-14T11:22:57.611456+0000","last_unstale":"2023-10-14T11:22:59.618069+0000","last_undegraded":"2023-10-14T11:22:59.618069+0000","last_fullsized":"2023-10-14T11:22:59.618069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427171+0000","last_change":"2023-10-14T11:22:58.617910+0000","last_active":"2023-10-14T11:23:00.427171+0000","last_peered":"2023-10-14T11:23:00.427171+0000","last_clean":"2023-10-14T11:23:00.427171+0000","last_became_active":"2023-10-14T11:22:58.617592+0000","last_became_peered":"2023-10-14T11:22:58.617592+0000","last_unstale":"2023-10-14T11:23:00.427171+0000","last_undegraded":"2023-10-14T11:23:00.427171+0000","last_fullsized":"2023-10-14T11:23:00.427171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427178+0000","last_change":"2023-10-14T11:22:57.606300+0000","last_active":"2023-10-14T11:23:00.427178+0000","last_peered":"2023-10-14T11:23:00.427178+0000","last_clean":"2023-10-14T11:23:00.427178+0000","last_became_active":"2023-10-14T11:22:57.606037+0000","last_became_peered":"2023-10-14T11:22:57.606037+0000","last_unstale":"2023-10-14T11:23:00.427178+0000","last_undegraded":"2023-10-14T11:23:00.427178+0000","last_fullsized":"2023-10-14T11:23:00.427178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618927+0000","last_change":"2023-10-14T11:22:58.620639+0000","last_active":"2023-10-14T11:22:59.618927+0000","last_peered":"2023-10-14T11:22:59.618927+0000","last_clean":"2023-10-14T11:22:59.618927+0000","last_became_active":"2023-10-14T11:22:58.620323+0000","last_became_peered":"2023-10-14T11:22:58.620323+0000","last_unstale":"2023-10-14T11:22:59.618927+0000","last_undegraded":"2023-10-14T11:22:59.618927+0000","last_fullsized":"2023-10-14T11:22:59.618927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427113+0000","last_change":"2023-10-14T11:22:57.604253+0000","last_active":"2023-10-14T11:23:00.427113+0000","last_peered":"2023-10-14T11:23:00.427113+0000","last_clean":"2023-10-14T11:23:00.427113+0000","last_became_active":"2023-10-14T11:22:57.603834+0000","last_became_peered":"2023-10-14T11:22:57.603834+0000","last_unstale":"2023-10-14T11:23:00.427113+0000","last_undegraded":"2023-10-14T11:23:00.427113+0000","last_fullsized":"2023-10-14T11:23:00.427113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427260+0000","last_change":"2023-10-14T11:22:58.637349+0000","last_active":"2023-10-14T11:23:00.427260+0000","last_peered":"2023-10-14T11:23:00.427260+0000","last_clean":"2023-10-14T11:23:00.427260+0000","last_became_active":"2023-10-14T11:22:58.636859+0000","last_became_peered":"2023-10-14T11:22:58.636859+0000","last_unstale":"2023-10-14T11:23:00.427260+0000","last_undegraded":"2023-10-14T11:23:00.427260+0000","last_fullsized":"2023-10-14T11:23:00.427260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617923+0000","last_change":"2023-10-14T11:22:57.603889+0000","last_active":"2023-10-14T11:22:59.617923+0000","last_peered":"2023-10-14T11:22:59.617923+0000","last_clean":"2023-10-14T11:22:59.617923+0000","last_became_active":"2023-10-14T11:22:57.603358+0000","last_became_peered":"2023-10-14T11:22:57.603358+0000","last_unstale":"2023-10-14T11:22:59.617923+0000","last_undegraded":"2023-10-14T11:22:59.617923+0000","last_fullsized":"2023-10-14T11:22:59.617923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618346+0000","last_change":"2023-10-14T11:22:58.635498+0000","last_active":"2023-10-14T11:22:59.618346+0000","last_peered":"2023-10-14T11:22:59.618346+0000","last_clean":"2023-10-14T11:22:59.618346+0000","last_became_active":"2023-10-14T11:22:58.635215+0000","last_became_peered":"2023-10-14T11:22:58.635215+0000","last_unstale":"2023-10-14T11:22:59.618346+0000","last_undegraded":"2023-10-14T11:22:59.618346+0000","last_fullsized":"2023-10-14T11:22:59.618346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427227+0000","last_change":"2023-10-14T11:22:57.606591+0000","last_active":"2023-10-14T11:23:00.427227+0000","last_peered":"2023-10-14T11:23:00.427227+0000","last_clean":"2023-10-14T11:23:00.427227+0000","last_became_active":"2023-10-14T11:22:57.606272+0000","last_became_peered":"2023-10-14T11:22:57.606272+0000","last_unstale":"2023-10-14T11:23:00.427227+0000","last_undegraded":"2023-10-14T11:23:00.427227+0000","last_fullsized":"2023-10-14T11:23:00.427227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:07.081725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427267+0000","last_change":"2023-10-14T11:22:58.624516+0000","last_active":"2023-10-14T11:23:00.427267+0000","last_peered":"2023-10-14T11:23:00.427267+0000","last_clean":"2023-10-14T11:23:00.427267+0000","last_became_active":"2023-10-14T11:22:58.624262+0000","last_became_peered":"2023-10-14T11:22:58.624262+0000","last_unstale":"2023-10-14T11:23:00.427267+0000","last_undegraded":"2023-10-14T11:23:00.427267+0000","last_fullsized":"2023-10-14T11:23:00.427267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:41.568935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619150+0000","last_change":"2023-10-14T11:22:58.615924+0000","last_active":"2023-10-14T11:22:59.619150+0000","last_peered":"2023-10-14T11:22:59.619150+0000","last_clean":"2023-10-14T11:22:59.619150+0000","last_became_active":"2023-10-14T11:22:58.615653+0000","last_became_peered":"2023-10-14T11:22:58.615653+0000","last_unstale":"2023-10-14T11:22:59.619150+0000","last_undegraded":"2023-10-14T11:22:59.619150+0000","last_fullsized":"2023-10-14T11:22:59.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426889+0000","last_change":"2023-10-14T11:22:58.634167+0000","last_active":"2023-10-14T11:23:00.426889+0000","last_peered":"2023-10-14T11:23:00.426889+0000","last_clean":"2023-10-14T11:23:00.426889+0000","last_became_active":"2023-10-14T11:22:58.633831+0000","last_became_peered":"2023-10-14T11:22:58.633831+0000","last_unstale":"2023-10-14T11:23:00.426889+0000","last_undegraded":"2023-10-14T11:23:00.426889+0000","last_fullsized":"2023-10-14T11:23:00.426889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618281+0000","last_change":"2023-10-14T11:22:58.632601+0000","last_active":"2023-10-14T11:22:59.618281+0000","last_peered":"2023-10-14T11:22:59.618281+0000","last_clean":"2023-10-14T11:22:59.618281+0000","last_became_active":"2023-10-14T11:22:58.631418+0000","last_became_peered":"2023-10-14T11:22:58.631418+0000","last_unstale":"2023-10-14T11:22:59.618281+0000","last_undegraded":"2023-10-14T11:22:59.618281+0000","last_fullsized":"2023-10-14T11:22:59.618281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203655+0000","last_change":"2023-10-14T11:22:58.622439+0000","last_active":"2023-10-14T11:23:00.203655+0000","last_peered":"2023-10-14T11:23:00.203655+0000","last_clean":"2023-10-14T11:23:00.203655+0000","last_became_active":"2023-10-14T11:22:58.621939+0000","last_became_peered":"2023-10-14T11:22:58.621939+0000","last_unstale":"2023-10-14T11:23:00.203655+0000","last_undegraded":"2023-10-14T11:23:00.203655+0000","last_fullsized":"2023-10-14T11:23:00.203655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427574+0000","last_change":"2023-10-14T11:22:58.626653+0000","last_active":"2023-10-14T11:23:00.427574+0000","last_peered":"2023-10-14T11:23:00.427574+0000","last_clean":"2023-10-14T11:23:00.427574+0000","last_became_active":"2023-10-14T11:22:58.626288+0000","last_became_peered":"2023-10-14T11:22:58.626288+0000","last_unstale":"2023-10-14T11:23:00.427574+0000","last_undegraded":"2023-10-14T11:23:00.427574+0000","last_fullsized":"2023-10-14T11:23:00.427574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617858+0000","last_change":"2023-10-14T11:22:58.621575+0000","last_active":"2023-10-14T11:22:59.617858+0000","last_peered":"2023-10-14T11:22:59.617858+0000","last_clean":"2023-10-14T11:22:59.617858+0000","last_became_active":"2023-10-14T11:22:58.621301+0000","last_became_peered":"2023-10-14T11:22:58.621301+0000","last_unstale":"2023-10-14T11:22:59.617858+0000","last_undegraded":"2023-10-14T11:22:59.617858+0000","last_fullsized":"2023-10-14T11:22:59.617858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619414+0000","last_change":"2023-10-14T11:22:58.617260+0000","last_active":"2023-10-14T11:22:59.619414+0000","last_peered":"2023-10-14T11:22:59.619414+0000","last_clean":"2023-10-14T11:22:59.619414+0000","last_became_active":"2023-10-14T11:22:58.616942+0000","last_became_peered":"2023-10-14T11:22:58.616942+0000","last_unstale":"2023-10-14T11:22:59.619414+0000","last_undegraded":"2023-10-14T11:22:59.619414+0000","last_fullsized":"2023-10-14T11:22:59.619414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427129+0000","last_change":"2023-10-14T11:22:58.625872+0000","last_active":"2023-10-14T11:23:00.427129+0000","last_peered":"2023-10-14T11:23:00.427129+0000","last_clean":"2023-10-14T11:23:00.427129+0000","last_became_active":"2023-10-14T11:22:58.625135+0000","last_became_peered":"2023-10-14T11:22:58.625135+0000","last_unstale":"2023-10-14T11:23:00.427129+0000","last_undegraded":"2023-10-14T11:23:00.427129+0000","last_fullsized":"2023-10-14T11:23:00.427129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618343+0000","last_change":"2023-10-14T11:22:58.632773+0000","last_active":"2023-10-14T11:22:59.618343+0000","last_peered":"2023-10-14T11:22:59.618343+0000","last_clean":"2023-10-14T11:22:59.618343+0000","last_became_active":"2023-10-14T11:22:58.632477+0000","last_became_peered":"2023-10-14T11:22:58.632477+0000","last_unstale":"2023-10-14T11:22:59.618343+0000","last_undegraded":"2023-10-14T11:22:59.618343+0000","last_fullsized":"2023-10-14T11:22:59.618343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426723+0000","last_change":"2023-10-14T11:22:58.626903+0000","last_active":"2023-10-14T11:23:00.426723+0000","last_peered":"2023-10-14T11:23:00.426723+0000","last_clean":"2023-10-14T11:23:00.426723+0000","last_became_active":"2023-10-14T11:22:58.625083+0000","last_became_peered":"2023-10-14T11:22:58.625083+0000","last_unstale":"2023-10-14T11:23:00.426723+0000","last_undegraded":"2023-10-14T11:23:00.426723+0000","last_fullsized":"2023-10-14T11:23:00.426723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618096+0000","last_change":"2023-10-14T11:22:58.631322+0000","last_active":"2023-10-14T11:22:59.618096+0000","last_peered":"2023-10-14T11:22:59.618096+0000","last_clean":"2023-10-14T11:22:59.618096+0000","last_became_active":"2023-10-14T11:22:58.631036+0000","last_became_peered":"2023-10-14T11:22:58.631036+0000","last_unstale":"2023-10-14T11:22:59.618096+0000","last_undegraded":"2023-10-14T11:22:59.618096+0000","last_fullsized":"2023-10-14T11:22:59.618096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203634+0000","last_change":"2023-10-14T11:22:58.622242+0000","last_active":"2023-10-14T11:23:00.203634+0000","last_peered":"2023-10-14T11:23:00.203634+0000","last_clean":"2023-10-14T11:23:00.203634+0000","last_became_active":"2023-10-14T11:22:58.621364+0000","last_became_peered":"2023-10-14T11:22:58.621364+0000","last_unstale":"2023-10-14T11:23:00.203634+0000","last_undegraded":"2023-10-14T11:23:00.203634+0000","last_fullsized":"2023-10-14T11:23:00.203634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619405+0000","last_change":"2023-10-14T11:22:58.624828+0000","last_active":"2023-10-14T11:22:59.619405+0000","last_peered":"2023-10-14T11:22:59.619405+0000","last_clean":"2023-10-14T11:22:59.619405+0000","last_became_active":"2023-10-14T11:22:58.624570+0000","last_became_peered":"2023-10-14T11:22:58.624570+0000","last_unstale":"2023-10-14T11:22:59.619405+0000","last_undegraded":"2023-10-14T11:22:59.619405+0000","last_fullsized":"2023-10-14T11:22:59.619405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:02.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:02.766 INFO:tasks.ceph.mds.d.smithi072.stderr:2023-10-14T11:23:02.764+0000 7f356cebd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:23:02.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.919+0000 7f53fed45700 1 Processor -- start 2023-10-14T11:23:02.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.919+0000 7f53fed45700 1 -- start start 2023-10-14T11:23:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fed45700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f53f80ceb30 0x7f53f80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fed45700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53f80cdc30 0x7f53f80cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fed45700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f80cef10 con 0x7f53f80cffe0 2023-10-14T11:23:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fed45700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80d2090 con 0x7f53f80cdc30 2023-10-14T11:23:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fed45700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f815deb0 con 0x7f53f80ceb30 2023-10-14T11:23:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53f80cdc30 0x7f53f80cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f53f80cdc30 0x7f53f80cfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41264/0 (socket says 172.21.15.67:41264) 2023-10-14T11:23:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 -- 172.21.15.67:0/2756491715 learned_addr learned my addr 172.21.15.67:0/2756491715 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53fcae1700 1 --2- 172.21.15.67:0/2756491715 >> v2:172.21.15.72:3300/0 conn(0x7f53f80ceb30 0x7f53f80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 -- 172.21.15.67:0/2756491715 >> v2:172.21.15.72:3300/0 conn(0x7f53f80ceb30 msgr2=0x7f53f80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 --2- 172.21.15.67:0/2756491715 >> v2:172.21.15.72:3300/0 conn(0x7f53f80ceb30 0x7f53f80b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 -- 172.21.15.67:0/2756491715 >> v1:172.21.15.72:6789/0 conn(0x7f53f80cffe0 legacy=0x7f53f815f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 -- 172.21.15.67:0/2756491715 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80d22e0 con 0x7f53f80cdc30 2023-10-14T11:23:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f7fff700 1 --2- 172.21.15.67:0/2756491715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f80cfaa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53f80722b0 tx=0x7f53e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e041e87c8d1d259 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.920+0000 7f53f77fe700 1 -- 172.21.15.67:0/2756491715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4004230 con 0x7f53f80cdc30 2023-10-14T11:23:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53f77fe700 1 -- 172.21.15.67:0/2756491715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4004390 con 0x7f53f80cdc30 2023-10-14T11:23:02.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53f77fe700 1 -- 172.21.15.67:0/2756491715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40036a0 con 0x7f53f80cdc30 2023-10-14T11:23:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 -- 172.21.15.67:0/2756491715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 msgr2=0x7f53f80cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 --2- 172.21.15.67:0/2756491715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f80cfaa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f53f80722b0 tx=0x7f53e4009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 -- 172.21.15.67:0/2756491715 shutdown_connections 2023-10-14T11:23:02.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 --2- 172.21.15.67:0/2756491715 >> v2:172.21.15.72:3300/0 conn(0x7f53f80ceb30 0x7f53f80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 --2- 172.21.15.67:0/2756491715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f80cfaa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 -- 172.21.15.67:0/2756491715 >> 172.21.15.67:0/2756491715 conn(0x7f53f80d1570 msgr2=0x7f53f80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 -- 172.21.15.67:0/2756491715 shutdown_connections 2023-10-14T11:23:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.921+0000 7f53fed45700 1 -- 172.21.15.67:0/2756491715 wait complete. 2023-10-14T11:23:02.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.922+0000 7f53fed45700 1 Processor -- start 2023-10-14T11:23:02.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.922+0000 7f53fed45700 1 -- start start 2023-10-14T11:23:02.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f80ceb30 0x7f53f815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53f80cffe0 0x7f53f815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c79d0 con 0x7f53f80cdc30 2023-10-14T11:23:02.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c6b00 con 0x7f53f80ceb30 2023-10-14T11:23:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fed45700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80c6dc0 con 0x7f53f80cffe0 2023-10-14T11:23:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41272/0 (socket says 172.21.15.67:41272) 2023-10-14T11:23:02.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 -- 172.21.15.67:0/4047036071 learned_addr learned my addr 172.21.15.67:0/4047036071 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53f7fff700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f80ceb30 0x7f53f815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fd2e2700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53f80cffe0 0x7f53f815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 -- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53f80cffe0 msgr2=0x7f53f815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53f80cffe0 0x7f53f815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 -- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f80ceb30 msgr2=0x7f53f815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f80ceb30 0x7f53f815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.923+0000 7f53fcae1700 1 -- 172.21.15.67:0/4047036071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009550 con 0x7f53f80cdc30 2023-10-14T11:23:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53fcae1700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c7f0 tx=0x7f53ec00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011800 con 0x7f53f80cdc30 2023-10-14T11:23:02.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec011960 con 0x7f53f80cdc30 2023-10-14T11:23:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f80c70a0 con 0x7f53f80cdc30 2023-10-14T11:23:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec011cf0 con 0x7f53f80cdc30 2023-10-14T11:23:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.924+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f80c7660 con 0x7f53f80cdc30 2023-10-14T11:23:02.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.925+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f80ae870 con 0x7f53f80cdc30 2023-10-14T11:23:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.925+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53ec018360 con 0x7f53f80cdc30 2023-10-14T11:23:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.926+0000 7f53f57fa700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 0x7f53dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.926+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53ec089560 con 0x7f53f80cdc30 2023-10-14T11:23:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.926+0000 7f53f7fff700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 0x7f53dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:02.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.926+0000 7f53f7fff700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 0x7f53dc06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009130 tx=0x7f53e4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:02.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:02.930+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53ec054610 con 0x7f53f80cdc30 2023-10-14T11:23:03.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.126+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f53f80cf580 con 0x7f53dc06af00 2023-10-14T11:23:03.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.133+0000 7f53f57fa700 1 -- 172.21.15.67:0/4047036071 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264658 (secure 0 0 0) 0x7f53e4020070 con 0x7f53dc06af00 2023-10-14T11:23:03.139 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:03.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 msgr2=0x7f53dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 0x7f53dc06d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009130 tx=0x7f53e4008030 comp rx=0 tx=0).stop 2023-10-14T11:23:03.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 msgr2=0x7f53f814fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00c7f0 tx=0x7f53ec00cbb0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 shutdown_connections 2023-10-14T11:23:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f53f80cffe0 0x7f53f815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53dc06af00 0x7f53dc06d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f53f80cdc30 0x7f53f814fdd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 --2- 172.21.15.67:0/4047036071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f53f80ceb30 0x7f53f815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 >> 172.21.15.67:0/4047036071 conn(0x7f53f80d1570 msgr2=0x7f53f80afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 shutdown_connections 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.137+0000 7f53fed45700 1 -- 172.21.15.67:0/4047036071 wait complete. 2023-10-14T11:23:03.143 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:03.151 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-14T11:23:02.401374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":125,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.812595"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427431+0000","last_change":"2023-10-14T11:22:58.633786+0000","last_active":"2023-10-14T11:23:00.427431+0000","last_peered":"2023-10-14T11:23:00.427431+0000","last_clean":"2023-10-14T11:23:00.427431+0000","last_became_active":"2023-10-14T11:22:58.633501+0000","last_became_peered":"2023-10-14T11:22:58.633501+0000","last_unstale":"2023-10-14T11:23:00.427431+0000","last_undegraded":"2023-10-14T11:23:00.427431+0000","last_fullsized":"2023-10-14T11:23:00.427431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:23.198990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618109+0000","last_change":"2023-10-14T11:22:58.622868+0000","last_active":"2023-10-14T11:22:59.618109+0000","last_peered":"2023-10-14T11:22:59.618109+0000","last_clean":"2023-10-14T11:22:59.618109+0000","last_became_active":"2023-10-14T11:22:58.622234+0000","last_became_peered":"2023-10-14T11:22:58.622234+0000","last_unstale":"2023-10-14T11:22:59.618109+0000","last_undegraded":"2023-10-14T11:22:59.618109+0000","last_fullsized":"2023-10-14T11:22:59.618109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203623+0000","last_change":"2023-10-14T11:22:58.624332+0000","last_active":"2023-10-14T11:23:00.203623+0000","last_peered":"2023-10-14T11:23:00.203623+0000","last_clean":"2023-10-14T11:23:00.203623+0000","last_became_active":"2023-10-14T11:22:58.623983+0000","last_became_peered":"2023-10-14T11:22:58.623983+0000","last_unstale":"2023-10-14T11:23:00.203623+0000","last_undegraded":"2023-10-14T11:23:00.203623+0000","last_fullsized":"2023-10-14T11:23:00.203623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618466+0000","last_change":"2023-10-14T11:22:58.633546+0000","last_active":"2023-10-14T11:22:59.618466+0000","last_peered":"2023-10-14T11:22:59.618466+0000","last_clean":"2023-10-14T11:22:59.618466+0000","last_became_active":"2023-10-14T11:22:58.632591+0000","last_became_peered":"2023-10-14T11:22:58.632591+0000","last_unstale":"2023-10-14T11:22:59.618466+0000","last_undegraded":"2023-10-14T11:22:59.618466+0000","last_fullsized":"2023-10-14T11:22:59.618466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427014+0000","last_change":"2023-10-14T11:22:58.625368+0000","last_active":"2023-10-14T11:23:00.427014+0000","last_peered":"2023-10-14T11:23:00.427014+0000","last_clean":"2023-10-14T11:23:00.427014+0000","last_became_active":"2023-10-14T11:22:58.622784+0000","last_became_peered":"2023-10-14T11:22:58.622784+0000","last_unstale":"2023-10-14T11:23:00.427014+0000","last_undegraded":"2023-10-14T11:23:00.427014+0000","last_fullsized":"2023-10-14T11:23:00.427014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617901+0000","last_change":"2023-10-14T11:22:58.639055+0000","last_active":"2023-10-14T11:22:59.617901+0000","last_peered":"2023-10-14T11:22:59.617901+0000","last_clean":"2023-10-14T11:22:59.617901+0000","last_became_active":"2023-10-14T11:22:58.638778+0000","last_became_peered":"2023-10-14T11:22:58.638778+0000","last_unstale":"2023-10-14T11:22:59.617901+0000","last_undegraded":"2023-10-14T11:22:59.617901+0000","last_fullsized":"2023-10-14T11:22:59.617901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426896+0000","last_change":"2023-10-14T11:22:58.627430+0000","last_active":"2023-10-14T11:23:00.426896+0000","last_peered":"2023-10-14T11:23:00.426896+0000","last_clean":"2023-10-14T11:23:00.426896+0000","last_became_active":"2023-10-14T11:22:58.621813+0000","last_became_peered":"2023-10-14T11:22:58.621813+0000","last_unstale":"2023-10-14T11:23:00.426896+0000","last_undegraded":"2023-10-14T11:23:00.426896+0000","last_fullsized":"2023-10-14T11:23:00.426896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426617+0000","last_change":"2023-10-14T11:22:58.634733+0000","last_active":"2023-10-14T11:23:00.426617+0000","last_peered":"2023-10-14T11:23:00.426617+0000","last_clean":"2023-10-14T11:23:00.426617+0000","last_became_active":"2023-10-14T11:22:58.634207+0000","last_became_peered":"2023-10-14T11:22:58.634207+0000","last_unstale":"2023-10-14T11:23:00.426617+0000","last_undegraded":"2023-10-14T11:23:00.426617+0000","last_fullsized":"2023-10-14T11:23:00.426617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427274+0000","last_change":"2023-10-14T11:22:58.637875+0000","last_active":"2023-10-14T11:23:00.427274+0000","last_peered":"2023-10-14T11:23:00.427274+0000","last_clean":"2023-10-14T11:23:00.427274+0000","last_became_active":"2023-10-14T11:22:58.637706+0000","last_became_peered":"2023-10-14T11:22:58.637706+0000","last_unstale":"2023-10-14T11:23:00.427274+0000","last_undegraded":"2023-10-14T11:23:00.427274+0000","last_fullsized":"2023-10-14T11:23:00.427274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:02:14.102087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619647+0000","last_change":"2023-10-14T11:22:58.632598+0000","last_active":"2023-10-14T11:22:59.619647+0000","last_peered":"2023-10-14T11:22:59.619647+0000","last_clean":"2023-10-14T11:22:59.619647+0000","last_became_active":"2023-10-14T11:22:58.632159+0000","last_became_peered":"2023-10-14T11:22:58.632159+0000","last_unstale":"2023-10-14T11:22:59.619647+0000","last_undegraded":"2023-10-14T11:22:59.619647+0000","last_fullsized":"2023-10-14T11:22:59.619647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619162+0000","last_change":"2023-10-14T11:22:58.635248+0000","last_active":"2023-10-14T11:22:59.619162+0000","last_peered":"2023-10-14T11:22:59.619162+0000","last_clean":"2023-10-14T11:22:59.619162+0000","last_became_active":"2023-10-14T11:22:58.634992+0000","last_became_peered":"2023-10-14T11:22:58.634992+0000","last_unstale":"2023-10-14T11:22:59.619162+0000","last_undegraded":"2023-10-14T11:22:59.619162+0000","last_fullsized":"2023-10-14T11:22:59.619162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919307+0000","last_change":"2023-10-14T11:22:58.624511+0000","last_active":"2023-10-14T11:22:59.919307+0000","last_peered":"2023-10-14T11:22:59.919307+0000","last_clean":"2023-10-14T11:22:59.919307+0000","last_became_active":"2023-10-14T11:22:58.623795+0000","last_became_peered":"2023-10-14T11:22:58.623795+0000","last_unstale":"2023-10-14T11:22:59.919307+0000","last_undegraded":"2023-10-14T11:22:59.919307+0000","last_fullsized":"2023-10-14T11:22:59.919307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:00.651862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427131+0000","last_change":"2023-10-14T11:22:58.620085+0000","last_active":"2023-10-14T11:23:00.427131+0000","last_peered":"2023-10-14T11:23:00.427131+0000","last_clean":"2023-10-14T11:23:00.427131+0000","last_became_active":"2023-10-14T11:22:58.619466+0000","last_became_peered":"2023-10-14T11:22:58.619466+0000","last_unstale":"2023-10-14T11:23:00.427131+0000","last_undegraded":"2023-10-14T11:23:00.427131+0000","last_fullsized":"2023-10-14T11:23:00.427131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203570+0000","last_change":"2023-10-14T11:22:58.618541+0000","last_active":"2023-10-14T11:23:00.203570+0000","last_peered":"2023-10-14T11:23:00.203570+0000","last_clean":"2023-10-14T11:23:00.203570+0000","last_became_active":"2023-10-14T11:22:58.618206+0000","last_became_peered":"2023-10-14T11:22:58.618206+0000","last_unstale":"2023-10-14T11:23:00.203570+0000","last_undegraded":"2023-10-14T11:23:00.203570+0000","last_fullsized":"2023-10-14T11:23:00.203570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617739+0000","last_change":"2023-10-14T11:22:58.625071+0000","last_active":"2023-10-14T11:22:59.617739+0000","last_peered":"2023-10-14T11:22:59.617739+0000","last_clean":"2023-10-14T11:22:59.617739+0000","last_became_active":"2023-10-14T11:22:58.624786+0000","last_became_peered":"2023-10-14T11:22:58.624786+0000","last_unstale":"2023-10-14T11:22:59.617739+0000","last_undegraded":"2023-10-14T11:22:59.617739+0000","last_fullsized":"2023-10-14T11:22:59.617739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617746+0000","last_change":"2023-10-14T11:22:58.632587+0000","last_active":"2023-10-14T11:22:59.617746+0000","last_peered":"2023-10-14T11:22:59.617746+0000","last_clean":"2023-10-14T11:22:59.617746+0000","last_became_active":"2023-10-14T11:22:58.631338+0000","last_became_peered":"2023-10-14T11:22:58.631338+0000","last_unstale":"2023-10-14T11:22:59.617746+0000","last_undegraded":"2023-10-14T11:22:59.617746+0000","last_fullsized":"2023-10-14T11:22:59.617746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618293+0000","last_change":"2023-10-14T11:22:58.637286+0000","last_active":"2023-10-14T11:22:59.618293+0000","last_peered":"2023-10-14T11:22:59.618293+0000","last_clean":"2023-10-14T11:22:59.618293+0000","last_became_active":"2023-10-14T11:22:58.636987+0000","last_became_peered":"2023-10-14T11:22:58.636987+0000","last_unstale":"2023-10-14T11:22:59.618293+0000","last_undegraded":"2023-10-14T11:22:59.618293+0000","last_fullsized":"2023-10-14T11:22:59.618293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427284+0000","last_change":"2023-10-14T11:22:58.627520+0000","last_active":"2023-10-14T11:23:00.427284+0000","last_peered":"2023-10-14T11:23:00.427284+0000","last_clean":"2023-10-14T11:23:00.427284+0000","last_became_active":"2023-10-14T11:22:58.627210+0000","last_became_peered":"2023-10-14T11:22:58.627210+0000","last_unstale":"2023-10-14T11:23:00.427284+0000","last_undegraded":"2023-10-14T11:23:00.427284+0000","last_fullsized":"2023-10-14T11:23:00.427284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427097+0000","last_change":"2023-10-14T11:22:58.625306+0000","last_active":"2023-10-14T11:23:00.427097+0000","last_peered":"2023-10-14T11:23:00.427097+0000","last_clean":"2023-10-14T11:23:00.427097+0000","last_became_active":"2023-10-14T11:22:58.625026+0000","last_became_peered":"2023-10-14T11:22:58.625026+0000","last_unstale":"2023-10-14T11:23:00.427097+0000","last_undegraded":"2023-10-14T11:23:00.427097+0000","last_fullsized":"2023-10-14T11:23:00.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203594+0000","last_change":"2023-10-14T11:22:57.606379+0000","last_active":"2023-10-14T11:23:00.203594+0000","last_peered":"2023-10-14T11:23:00.203594+0000","last_clean":"2023-10-14T11:23:00.203594+0000","last_became_active":"2023-10-14T11:22:57.606084+0000","last_became_peered":"2023-10-14T11:22:57.606084+0000","last_unstale":"2023-10-14T11:23:00.203594+0000","last_undegraded":"2023-10-14T11:23:00.203594+0000","last_fullsized":"2023-10-14T11:23:00.203594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:46.618392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427389+0000","last_change":"2023-10-14T11:22:58.617985+0000","last_active":"2023-10-14T11:23:00.427389+0000","last_peered":"2023-10-14T11:23:00.427389+0000","last_clean":"2023-10-14T11:23:00.427389+0000","last_became_active":"2023-10-14T11:22:58.617671+0000","last_became_peered":"2023-10-14T11:22:58.617671+0000","last_unstale":"2023-10-14T11:23:00.427389+0000","last_undegraded":"2023-10-14T11:23:00.427389+0000","last_fullsized":"2023-10-14T11:23:00.427389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427061+0000","last_change":"2023-10-14T11:22:57.606838+0000","last_active":"2023-10-14T11:23:00.427061+0000","last_peered":"2023-10-14T11:23:00.427061+0000","last_clean":"2023-10-14T11:23:00.427061+0000","last_became_active":"2023-10-14T11:22:57.606525+0000","last_became_peered":"2023-10-14T11:22:57.606525+0000","last_unstale":"2023-10-14T11:23:00.427061+0000","last_undegraded":"2023-10-14T11:23:00.427061+0000","last_fullsized":"2023-10-14T11:23:00.427061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203773+0000","last_change":"2023-10-14T11:22:58.635376+0000","last_active":"2023-10-14T11:23:00.203773+0000","last_peered":"2023-10-14T11:23:00.203773+0000","last_clean":"2023-10-14T11:23:00.203773+0000","last_became_active":"2023-10-14T11:22:58.635055+0000","last_became_peered":"2023-10-14T11:22:58.635055+0000","last_unstale":"2023-10-14T11:23:00.203773+0000","last_undegraded":"2023-10-14T11:23:00.203773+0000","last_fullsized":"2023-10-14T11:23:00.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427311+0000","last_change":"2023-10-14T11:22:57.606462+0000","last_active":"2023-10-14T11:23:00.427311+0000","last_peered":"2023-10-14T11:23:00.427311+0000","last_clean":"2023-10-14T11:23:00.427311+0000","last_became_active":"2023-10-14T11:22:57.606205+0000","last_became_peered":"2023-10-14T11:22:57.606205+0000","last_unstale":"2023-10-14T11:23:00.427311+0000","last_undegraded":"2023-10-14T11:23:00.427311+0000","last_fullsized":"2023-10-14T11:23:00.427311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619693+0000","last_change":"2023-10-14T11:22:58.634078+0000","last_active":"2023-10-14T11:22:59.619693+0000","last_peered":"2023-10-14T11:22:59.619693+0000","last_clean":"2023-10-14T11:22:59.619693+0000","last_became_active":"2023-10-14T11:22:58.633808+0000","last_became_peered":"2023-10-14T11:22:58.633808+0000","last_unstale":"2023-10-14T11:22:59.619693+0000","last_undegraded":"2023-10-14T11:22:59.619693+0000","last_fullsized":"2023-10-14T11:22:59.619693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426936+0000","last_change":"2023-10-14T11:22:57.608295+0000","last_active":"2023-10-14T11:23:00.426936+0000","last_peered":"2023-10-14T11:23:00.426936+0000","last_clean":"2023-10-14T11:23:00.426936+0000","last_became_active":"2023-10-14T11:22:57.607972+0000","last_became_peered":"2023-10-14T11:22:57.607972+0000","last_unstale":"2023-10-14T11:23:00.426936+0000","last_undegraded":"2023-10-14T11:23:00.426936+0000","last_fullsized":"2023-10-14T11:23:00.426936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:33.504370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618196+0000","last_change":"2023-10-14T11:22:58.633471+0000","last_active":"2023-10-14T11:22:59.618196+0000","last_peered":"2023-10-14T11:22:59.618196+0000","last_clean":"2023-10-14T11:22:59.618196+0000","last_became_active":"2023-10-14T11:22:58.633175+0000","last_became_peered":"2023-10-14T11:22:58.633175+0000","last_unstale":"2023-10-14T11:22:59.618196+0000","last_undegraded":"2023-10-14T11:22:59.618196+0000","last_fullsized":"2023-10-14T11:22:59.618196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427053+0000","last_change":"2023-10-14T11:22:57.608273+0000","last_active":"2023-10-14T11:23:00.427053+0000","last_peered":"2023-10-14T11:23:00.427053+0000","last_clean":"2023-10-14T11:23:00.427053+0000","last_became_active":"2023-10-14T11:22:57.607043+0000","last_became_peered":"2023-10-14T11:22:57.607043+0000","last_unstale":"2023-10-14T11:23:00.427053+0000","last_undegraded":"2023-10-14T11:23:00.427053+0000","last_fullsized":"2023-10-14T11:23:00.427053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918907+0000","last_change":"2023-10-14T11:22:58.618099+0000","last_active":"2023-10-14T11:22:59.918907+0000","last_peered":"2023-10-14T11:22:59.918907+0000","last_clean":"2023-10-14T11:22:59.918907+0000","last_became_active":"2023-10-14T11:22:58.617688+0000","last_became_peered":"2023-10-14T11:22:58.617688+0000","last_unstale":"2023-10-14T11:22:59.918907+0000","last_undegraded":"2023-10-14T11:22:59.918907+0000","last_fullsized":"2023-10-14T11:22:59.918907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:15.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619036+0000","last_change":"2023-10-14T11:22:57.596557+0000","last_active":"2023-10-14T11:22:59.619036+0000","last_peered":"2023-10-14T11:22:59.619036+0000","last_clean":"2023-10-14T11:22:59.619036+0000","last_became_active":"2023-10-14T11:22:57.596258+0000","last_became_peered":"2023-10-14T11:22:57.596258+0000","last_unstale":"2023-10-14T11:22:59.619036+0000","last_undegraded":"2023-10-14T11:22:59.619036+0000","last_fullsized":"2023-10-14T11:22:59.619036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203763+0000","last_change":"2023-10-14T11:22:58.624416+0000","last_active":"2023-10-14T11:23:00.203763+0000","last_peered":"2023-10-14T11:23:00.203763+0000","last_clean":"2023-10-14T11:23:00.203763+0000","last_became_active":"2023-10-14T11:22:58.624136+0000","last_became_peered":"2023-10-14T11:22:58.624136+0000","last_unstale":"2023-10-14T11:23:00.203763+0000","last_undegraded":"2023-10-14T11:23:00.203763+0000","last_fullsized":"2023-10-14T11:23:00.203763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426746+0000","last_change":"2023-10-14T11:22:57.607548+0000","last_active":"2023-10-14T11:23:00.426746+0000","last_peered":"2023-10-14T11:23:00.426746+0000","last_clean":"2023-10-14T11:23:00.426746+0000","last_became_active":"2023-10-14T11:22:57.607266+0000","last_became_peered":"2023-10-14T11:22:57.607266+0000","last_unstale":"2023-10-14T11:23:00.426746+0000","last_undegraded":"2023-10-14T11:23:00.426746+0000","last_fullsized":"2023-10-14T11:23:00.426746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427490+0000","last_change":"2023-10-14T11:22:58.627962+0000","last_active":"2023-10-14T11:23:00.427490+0000","last_peered":"2023-10-14T11:23:00.427490+0000","last_clean":"2023-10-14T11:23:00.427490+0000","last_became_active":"2023-10-14T11:22:58.627647+0000","last_became_peered":"2023-10-14T11:22:58.627647+0000","last_unstale":"2023-10-14T11:23:00.427490+0000","last_undegraded":"2023-10-14T11:23:00.427490+0000","last_fullsized":"2023-10-14T11:23:00.427490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618403+0000","last_change":"2023-10-14T11:22:57.601447+0000","last_active":"2023-10-14T11:22:59.618403+0000","last_peered":"2023-10-14T11:22:59.618403+0000","last_clean":"2023-10-14T11:22:59.618403+0000","last_became_active":"2023-10-14T11:22:57.601160+0000","last_became_peered":"2023-10-14T11:22:57.601160+0000","last_unstale":"2023-10-14T11:22:59.618403+0000","last_undegraded":"2023-10-14T11:22:59.618403+0000","last_fullsized":"2023-10-14T11:22:59.618403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617889+0000","last_change":"2023-10-14T11:22:58.619189+0000","last_active":"2023-10-14T11:22:59.617889+0000","last_peered":"2023-10-14T11:22:59.617889+0000","last_clean":"2023-10-14T11:22:59.617889+0000","last_became_active":"2023-10-14T11:22:58.618873+0000","last_became_peered":"2023-10-14T11:22:58.618873+0000","last_unstale":"2023-10-14T11:22:59.617889+0000","last_undegraded":"2023-10-14T11:22:59.617889+0000","last_fullsized":"2023-10-14T11:22:59.617889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619790+0000","last_change":"2023-10-14T11:22:57.601166+0000","last_active":"2023-10-14T11:22:59.619790+0000","last_peered":"2023-10-14T11:22:59.619790+0000","last_clean":"2023-10-14T11:22:59.619790+0000","last_became_active":"2023-10-14T11:22:57.600664+0000","last_became_peered":"2023-10-14T11:22:57.600664+0000","last_unstale":"2023-10-14T11:22:59.619790+0000","last_undegraded":"2023-10-14T11:22:59.619790+0000","last_fullsized":"2023-10-14T11:22:59.619790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618932+0000","last_change":"2023-10-14T11:22:58.638814+0000","last_active":"2023-10-14T11:22:59.618932+0000","last_peered":"2023-10-14T11:22:59.618932+0000","last_clean":"2023-10-14T11:22:59.618932+0000","last_became_active":"2023-10-14T11:22:58.638511+0000","last_became_peered":"2023-10-14T11:22:58.638511+0000","last_unstale":"2023-10-14T11:22:59.618932+0000","last_undegraded":"2023-10-14T11:22:59.618932+0000","last_fullsized":"2023-10-14T11:22:59.618932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618785+0000","last_change":"2023-10-14T11:22:57.605185+0000","last_active":"2023-10-14T11:22:59.618785+0000","last_peered":"2023-10-14T11:22:59.618785+0000","last_clean":"2023-10-14T11:22:59.618785+0000","last_became_active":"2023-10-14T11:22:57.604882+0000","last_became_peered":"2023-10-14T11:22:57.604882+0000","last_unstale":"2023-10-14T11:22:59.618785+0000","last_undegraded":"2023-10-14T11:22:59.618785+0000","last_fullsized":"2023-10-14T11:22:59.618785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:09.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203726+0000","last_change":"2023-10-14T11:22:58.635766+0000","last_active":"2023-10-14T11:23:00.203726+0000","last_peered":"2023-10-14T11:23:00.203726+0000","last_clean":"2023-10-14T11:23:00.203726+0000","last_became_active":"2023-10-14T11:22:58.635066+0000","last_became_peered":"2023-10-14T11:22:58.635066+0000","last_unstale":"2023-10-14T11:23:00.203726+0000","last_undegraded":"2023-10-14T11:23:00.203726+0000","last_fullsized":"2023-10-14T11:23:00.203726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617960+0000","last_change":"2023-10-14T11:22:57.604629+0000","last_active":"2023-10-14T11:22:59.617960+0000","last_peered":"2023-10-14T11:22:59.617960+0000","last_clean":"2023-10-14T11:22:59.617960+0000","last_became_active":"2023-10-14T11:22:57.604227+0000","last_became_peered":"2023-10-14T11:22:57.604227+0000","last_unstale":"2023-10-14T11:22:59.617960+0000","last_undegraded":"2023-10-14T11:22:59.617960+0000","last_fullsized":"2023-10-14T11:22:59.617960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919288+0000","last_change":"2023-10-14T11:22:58.624704+0000","last_active":"2023-10-14T11:22:59.919288+0000","last_peered":"2023-10-14T11:22:59.919288+0000","last_clean":"2023-10-14T11:22:59.919288+0000","last_became_active":"2023-10-14T11:22:58.624178+0000","last_became_peered":"2023-10-14T11:22:58.624178+0000","last_unstale":"2023-10-14T11:22:59.919288+0000","last_undegraded":"2023-10-14T11:22:59.919288+0000","last_fullsized":"2023-10-14T11:22:59.919288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619299+0000","last_change":"2023-10-14T11:22:57.611378+0000","last_active":"2023-10-14T11:22:59.619299+0000","last_peered":"2023-10-14T11:22:59.619299+0000","last_clean":"2023-10-14T11:22:59.619299+0000","last_became_active":"2023-10-14T11:22:57.611089+0000","last_became_peered":"2023-10-14T11:22:57.611089+0000","last_unstale":"2023-10-14T11:22:59.619299+0000","last_undegraded":"2023-10-14T11:22:59.619299+0000","last_fullsized":"2023-10-14T11:22:59.619299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427075+0000","last_change":"2023-10-14T11:22:58.625644+0000","last_active":"2023-10-14T11:23:00.427075+0000","last_peered":"2023-10-14T11:23:00.427075+0000","last_clean":"2023-10-14T11:23:00.427075+0000","last_became_active":"2023-10-14T11:22:58.621672+0000","last_became_peered":"2023-10-14T11:22:58.621672+0000","last_unstale":"2023-10-14T11:23:00.427075+0000","last_undegraded":"2023-10-14T11:23:00.427075+0000","last_fullsized":"2023-10-14T11:23:00.427075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203761+0000","last_change":"2023-10-14T11:22:57.595554+0000","last_active":"2023-10-14T11:23:00.203761+0000","last_peered":"2023-10-14T11:23:00.203761+0000","last_clean":"2023-10-14T11:23:00.203761+0000","last_became_active":"2023-10-14T11:22:57.595229+0000","last_became_peered":"2023-10-14T11:22:57.595229+0000","last_unstale":"2023-10-14T11:23:00.203761+0000","last_undegraded":"2023-10-14T11:23:00.203761+0000","last_fullsized":"2023-10-14T11:23:00.203761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203400+0000","last_change":"2023-10-14T11:22:58.617721+0000","last_active":"2023-10-14T11:23:00.203400+0000","last_peered":"2023-10-14T11:23:00.203400+0000","last_clean":"2023-10-14T11:23:00.203400+0000","last_became_active":"2023-10-14T11:22:58.617363+0000","last_became_peered":"2023-10-14T11:22:58.617363+0000","last_unstale":"2023-10-14T11:23:00.203400+0000","last_undegraded":"2023-10-14T11:23:00.203400+0000","last_fullsized":"2023-10-14T11:23:00.203400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:09.703756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618467+0000","last_change":"2023-10-14T11:22:57.607719+0000","last_active":"2023-10-14T11:22:59.618467+0000","last_peered":"2023-10-14T11:22:59.618467+0000","last_clean":"2023-10-14T11:22:59.618467+0000","last_became_active":"2023-10-14T11:22:57.607364+0000","last_became_peered":"2023-10-14T11:22:57.607364+0000","last_unstale":"2023-10-14T11:22:59.618467+0000","last_undegraded":"2023-10-14T11:22:59.618467+0000","last_fullsized":"2023-10-14T11:22:59.618467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427266+0000","last_change":"2023-10-14T11:22:58.634366+0000","last_active":"2023-10-14T11:23:00.427266+0000","last_peered":"2023-10-14T11:23:00.427266+0000","last_clean":"2023-10-14T11:23:00.427266+0000","last_became_active":"2023-10-14T11:22:58.634138+0000","last_became_peered":"2023-10-14T11:22:58.634138+0000","last_unstale":"2023-10-14T11:23:00.427266+0000","last_undegraded":"2023-10-14T11:23:00.427266+0000","last_fullsized":"2023-10-14T11:23:00.427266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619102+0000","last_change":"2023-10-14T11:22:57.597846+0000","last_active":"2023-10-14T11:22:59.619102+0000","last_peered":"2023-10-14T11:22:59.619102+0000","last_clean":"2023-10-14T11:22:59.619102+0000","last_became_active":"2023-10-14T11:22:57.597524+0000","last_became_peered":"2023-10-14T11:22:57.597524+0000","last_unstale":"2023-10-14T11:22:59.619102+0000","last_undegraded":"2023-10-14T11:22:59.619102+0000","last_fullsized":"2023-10-14T11:22:59.619102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619170+0000","last_change":"2023-10-14T11:22:58.616377+0000","last_active":"2023-10-14T11:22:59.619170+0000","last_peered":"2023-10-14T11:22:59.619170+0000","last_clean":"2023-10-14T11:22:59.619170+0000","last_became_active":"2023-10-14T11:22:58.616115+0000","last_became_peered":"2023-10-14T11:22:58.616115+0000","last_unstale":"2023-10-14T11:22:59.619170+0000","last_undegraded":"2023-10-14T11:22:59.619170+0000","last_fullsized":"2023-10-14T11:22:59.619170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426474+0000","last_change":"2023-10-14T11:22:57.604681+0000","last_active":"2023-10-14T11:23:00.426474+0000","last_peered":"2023-10-14T11:23:00.426474+0000","last_clean":"2023-10-14T11:23:00.426474+0000","last_became_active":"2023-10-14T11:22:57.604355+0000","last_became_peered":"2023-10-14T11:22:57.604355+0000","last_unstale":"2023-10-14T11:23:00.426474+0000","last_undegraded":"2023-10-14T11:23:00.426474+0000","last_fullsized":"2023-10-14T11:23:00.426474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426914+0000","last_change":"2023-10-14T11:22:58.633870+0000","last_active":"2023-10-14T11:23:00.426914+0000","last_peered":"2023-10-14T11:23:00.426914+0000","last_clean":"2023-10-14T11:23:00.426914+0000","last_became_active":"2023-10-14T11:22:58.633668+0000","last_became_peered":"2023-10-14T11:22:58.633668+0000","last_unstale":"2023-10-14T11:23:00.426914+0000","last_undegraded":"2023-10-14T11:23:00.426914+0000","last_fullsized":"2023-10-14T11:23:00.426914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919292+0000","last_change":"2023-10-14T11:22:57.596605+0000","last_active":"2023-10-14T11:22:59.919292+0000","last_peered":"2023-10-14T11:22:59.919292+0000","last_clean":"2023-10-14T11:22:59.919292+0000","last_became_active":"2023-10-14T11:22:57.596284+0000","last_became_peered":"2023-10-14T11:22:57.596284+0000","last_unstale":"2023-10-14T11:22:59.919292+0000","last_undegraded":"2023-10-14T11:22:59.919292+0000","last_fullsized":"2023-10-14T11:22:59.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427249+0000","last_change":"2023-10-14T11:22:58.628154+0000","last_active":"2023-10-14T11:23:00.427249+0000","last_peered":"2023-10-14T11:23:00.427249+0000","last_clean":"2023-10-14T11:23:00.427249+0000","last_became_active":"2023-10-14T11:22:58.627867+0000","last_became_peered":"2023-10-14T11:22:58.627867+0000","last_unstale":"2023-10-14T11:23:00.427249+0000","last_undegraded":"2023-10-14T11:23:00.427249+0000","last_fullsized":"2023-10-14T11:23:00.427249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617938+0000","last_change":"2023-10-14T11:22:57.603369+0000","last_active":"2023-10-14T11:22:59.617938+0000","last_peered":"2023-10-14T11:22:59.617938+0000","last_clean":"2023-10-14T11:22:59.617938+0000","last_became_active":"2023-10-14T11:22:57.603018+0000","last_became_peered":"2023-10-14T11:22:57.603018+0000","last_unstale":"2023-10-14T11:22:59.617938+0000","last_undegraded":"2023-10-14T11:22:59.617938+0000","last_fullsized":"2023-10-14T11:22:59.617938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618471+0000","last_change":"2023-10-14T11:22:58.631463+0000","last_active":"2023-10-14T11:22:59.618471+0000","last_peered":"2023-10-14T11:22:59.618471+0000","last_clean":"2023-10-14T11:22:59.618471+0000","last_became_active":"2023-10-14T11:22:58.630763+0000","last_became_peered":"2023-10-14T11:22:58.630763+0000","last_unstale":"2023-10-14T11:22:59.618471+0000","last_undegraded":"2023-10-14T11:22:59.618471+0000","last_fullsized":"2023-10-14T11:22:59.618471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618387+0000","last_change":"2023-10-14T11:22:57.604539+0000","last_active":"2023-10-14T11:22:59.618387+0000","last_peered":"2023-10-14T11:22:59.618387+0000","last_clean":"2023-10-14T11:22:59.618387+0000","last_became_active":"2023-10-14T11:22:57.604263+0000","last_became_peered":"2023-10-14T11:22:57.604263+0000","last_unstale":"2023-10-14T11:22:59.618387+0000","last_undegraded":"2023-10-14T11:22:59.618387+0000","last_fullsized":"2023-10-14T11:22:59.618387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919024+0000","last_change":"2023-10-14T11:22:58.632118+0000","last_active":"2023-10-14T11:22:59.919024+0000","last_peered":"2023-10-14T11:22:59.919024+0000","last_clean":"2023-10-14T11:22:59.919024+0000","last_became_active":"2023-10-14T11:22:58.631651+0000","last_became_peered":"2023-10-14T11:22:58.631651+0000","last_unstale":"2023-10-14T11:22:59.919024+0000","last_undegraded":"2023-10-14T11:22:59.919024+0000","last_fullsized":"2023-10-14T11:22:59.919024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617780+0000","last_change":"2023-10-14T11:22:58.622493+0000","last_active":"2023-10-14T11:22:59.617780+0000","last_peered":"2023-10-14T11:22:59.617780+0000","last_clean":"2023-10-14T11:22:59.617780+0000","last_became_active":"2023-10-14T11:22:58.622121+0000","last_became_peered":"2023-10-14T11:22:58.622121+0000","last_unstale":"2023-10-14T11:22:59.617780+0000","last_undegraded":"2023-10-14T11:22:59.617780+0000","last_fullsized":"2023-10-14T11:22:59.617780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426598+0000","last_change":"2023-10-14T11:22:57.607846+0000","last_active":"2023-10-14T11:23:00.426598+0000","last_peered":"2023-10-14T11:23:00.426598+0000","last_clean":"2023-10-14T11:23:00.426598+0000","last_became_active":"2023-10-14T11:22:57.607545+0000","last_became_peered":"2023-10-14T11:22:57.607545+0000","last_unstale":"2023-10-14T11:23:00.426598+0000","last_undegraded":"2023-10-14T11:23:00.426598+0000","last_fullsized":"2023-10-14T11:23:00.426598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426906+0000","last_change":"2023-10-14T11:22:58.634690+0000","last_active":"2023-10-14T11:23:00.426906+0000","last_peered":"2023-10-14T11:23:00.426906+0000","last_clean":"2023-10-14T11:23:00.426906+0000","last_became_active":"2023-10-14T11:22:58.634441+0000","last_became_peered":"2023-10-14T11:22:58.634441+0000","last_unstale":"2023-10-14T11:23:00.426906+0000","last_undegraded":"2023-10-14T11:23:00.426906+0000","last_fullsized":"2023-10-14T11:23:00.426906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617821+0000","last_change":"2023-10-14T11:22:57.606397+0000","last_active":"2023-10-14T11:22:59.617821+0000","last_peered":"2023-10-14T11:22:59.617821+0000","last_clean":"2023-10-14T11:22:59.617821+0000","last_became_active":"2023-10-14T11:22:57.606142+0000","last_became_peered":"2023-10-14T11:22:57.606142+0000","last_unstale":"2023-10-14T11:22:59.617821+0000","last_undegraded":"2023-10-14T11:22:59.617821+0000","last_fullsized":"2023-10-14T11:22:59.617821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T11:22:58.611333+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:22:58.611333+0000","last_peered":"2023-10-14T11:22:58.611333+0000","last_clean":"2023-10-14T11:22:58.611333+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:22:58.611333+0000","last_undegraded":"2023-10-14T11:22:58.611333+0000","last_fullsized":"2023-10-14T11:22:58.611333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203375+0000","last_change":"2023-10-14T11:22:58.619533+0000","last_active":"2023-10-14T11:23:00.203375+0000","last_peered":"2023-10-14T11:23:00.203375+0000","last_clean":"2023-10-14T11:23:00.203375+0000","last_became_active":"2023-10-14T11:22:58.618854+0000","last_became_peered":"2023-10-14T11:22:58.618854+0000","last_unstale":"2023-10-14T11:23:00.203375+0000","last_undegraded":"2023-10-14T11:23:00.203375+0000","last_fullsized":"2023-10-14T11:23:00.203375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:03.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426745+0000","last_change":"2023-10-14T11:22:57.611514+0000","last_active":"2023-10-14T11:23:00.426745+0000","last_peered":"2023-10-14T11:23:00.426745+0000","last_clean":"2023-10-14T11:23:00.426745+0000","last_became_active":"2023-10-14T11:22:57.611164+0000","last_became_peered":"2023-10-14T11:22:57.611164+0000","last_unstale":"2023-10-14T11:23:00.426745+0000","last_undegraded":"2023-10-14T11:23:00.426745+0000","last_fullsized":"2023-10-14T11:23:00.426745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427204+0000","last_change":"2023-10-14T11:22:57.605364+0000","last_active":"2023-10-14T11:23:00.427204+0000","last_peered":"2023-10-14T11:23:00.427204+0000","last_clean":"2023-10-14T11:23:00.427204+0000","last_became_active":"2023-10-14T11:22:57.605054+0000","last_became_peered":"2023-10-14T11:22:57.605054+0000","last_unstale":"2023-10-14T11:23:00.427204+0000","last_undegraded":"2023-10-14T11:23:00.427204+0000","last_fullsized":"2023-10-14T11:23:00.427204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617883+0000","last_change":"2023-10-14T11:22:58.622614+0000","last_active":"2023-10-14T11:22:59.617883+0000","last_peered":"2023-10-14T11:22:59.617883+0000","last_clean":"2023-10-14T11:22:59.617883+0000","last_became_active":"2023-10-14T11:22:58.622225+0000","last_became_peered":"2023-10-14T11:22:58.622225+0000","last_unstale":"2023-10-14T11:22:59.617883+0000","last_undegraded":"2023-10-14T11:22:59.617883+0000","last_fullsized":"2023-10-14T11:22:59.617883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617793+0000","last_change":"2023-10-14T11:22:57.604443+0000","last_active":"2023-10-14T11:22:59.617793+0000","last_peered":"2023-10-14T11:22:59.617793+0000","last_clean":"2023-10-14T11:22:59.617793+0000","last_became_active":"2023-10-14T11:22:57.604109+0000","last_became_peered":"2023-10-14T11:22:57.604109+0000","last_unstale":"2023-10-14T11:22:59.617793+0000","last_undegraded":"2023-10-14T11:22:59.617793+0000","last_fullsized":"2023-10-14T11:22:59.617793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427299+0000","last_change":"2023-10-14T11:22:58.619248+0000","last_active":"2023-10-14T11:23:00.427299+0000","last_peered":"2023-10-14T11:23:00.427299+0000","last_clean":"2023-10-14T11:23:00.427299+0000","last_became_active":"2023-10-14T11:22:58.618115+0000","last_became_peered":"2023-10-14T11:22:58.618115+0000","last_unstale":"2023-10-14T11:23:00.427299+0000","last_undegraded":"2023-10-14T11:23:00.427299+0000","last_fullsized":"2023-10-14T11:23:00.427299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619698+0000","last_change":"2023-10-14T11:22:57.606345+0000","last_active":"2023-10-14T11:22:59.619698+0000","last_peered":"2023-10-14T11:22:59.619698+0000","last_clean":"2023-10-14T11:22:59.619698+0000","last_became_active":"2023-10-14T11:22:57.606077+0000","last_became_peered":"2023-10-14T11:22:57.606077+0000","last_unstale":"2023-10-14T11:22:59.619698+0000","last_undegraded":"2023-10-14T11:22:59.619698+0000","last_fullsized":"2023-10-14T11:22:59.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203626+0000","last_change":"2023-10-14T11:22:58.619914+0000","last_active":"2023-10-14T11:23:00.203626+0000","last_peered":"2023-10-14T11:23:00.203626+0000","last_clean":"2023-10-14T11:23:00.203626+0000","last_became_active":"2023-10-14T11:22:58.619545+0000","last_became_peered":"2023-10-14T11:22:58.619545+0000","last_unstale":"2023-10-14T11:23:00.203626+0000","last_undegraded":"2023-10-14T11:23:00.203626+0000","last_fullsized":"2023-10-14T11:23:00.203626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426640+0000","last_change":"2023-10-14T11:22:57.606954+0000","last_active":"2023-10-14T11:23:00.426640+0000","last_peered":"2023-10-14T11:23:00.426640+0000","last_clean":"2023-10-14T11:23:00.426640+0000","last_became_active":"2023-10-14T11:22:57.606659+0000","last_became_peered":"2023-10-14T11:22:57.606659+0000","last_unstale":"2023-10-14T11:23:00.426640+0000","last_undegraded":"2023-10-14T11:23:00.426640+0000","last_fullsized":"2023-10-14T11:23:00.426640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918996+0000","last_change":"2023-10-14T11:22:58.622532+0000","last_active":"2023-10-14T11:22:59.918996+0000","last_peered":"2023-10-14T11:22:59.918996+0000","last_clean":"2023-10-14T11:22:59.918996+0000","last_became_active":"2023-10-14T11:22:58.622238+0000","last_became_peered":"2023-10-14T11:22:58.622238+0000","last_unstale":"2023-10-14T11:22:59.918996+0000","last_undegraded":"2023-10-14T11:22:59.918996+0000","last_fullsized":"2023-10-14T11:22:59.918996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:04.332572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617982+0000","last_change":"2023-10-14T11:22:57.608859+0000","last_active":"2023-10-14T11:22:59.617982+0000","last_peered":"2023-10-14T11:22:59.617982+0000","last_clean":"2023-10-14T11:22:59.617982+0000","last_became_active":"2023-10-14T11:22:57.608589+0000","last_became_peered":"2023-10-14T11:22:57.608589+0000","last_unstale":"2023-10-14T11:22:59.617982+0000","last_undegraded":"2023-10-14T11:22:59.617982+0000","last_fullsized":"2023-10-14T11:22:59.617982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426871+0000","last_change":"2023-10-14T11:22:58.616287+0000","last_active":"2023-10-14T11:23:00.426871+0000","last_peered":"2023-10-14T11:23:00.426871+0000","last_clean":"2023-10-14T11:23:00.426871+0000","last_became_active":"2023-10-14T11:22:58.615925+0000","last_became_peered":"2023-10-14T11:22:58.615925+0000","last_unstale":"2023-10-14T11:23:00.426871+0000","last_undegraded":"2023-10-14T11:23:00.426871+0000","last_fullsized":"2023-10-14T11:23:00.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618069+0000","last_change":"2023-10-14T11:22:57.611743+0000","last_active":"2023-10-14T11:22:59.618069+0000","last_peered":"2023-10-14T11:22:59.618069+0000","last_clean":"2023-10-14T11:22:59.618069+0000","last_became_active":"2023-10-14T11:22:57.611456+0000","last_became_peered":"2023-10-14T11:22:57.611456+0000","last_unstale":"2023-10-14T11:22:59.618069+0000","last_undegraded":"2023-10-14T11:22:59.618069+0000","last_fullsized":"2023-10-14T11:22:59.618069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427171+0000","last_change":"2023-10-14T11:22:58.617910+0000","last_active":"2023-10-14T11:23:00.427171+0000","last_peered":"2023-10-14T11:23:00.427171+0000","last_clean":"2023-10-14T11:23:00.427171+0000","last_became_active":"2023-10-14T11:22:58.617592+0000","last_became_peered":"2023-10-14T11:22:58.617592+0000","last_unstale":"2023-10-14T11:23:00.427171+0000","last_undegraded":"2023-10-14T11:23:00.427171+0000","last_fullsized":"2023-10-14T11:23:00.427171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427178+0000","last_change":"2023-10-14T11:22:57.606300+0000","last_active":"2023-10-14T11:23:00.427178+0000","last_peered":"2023-10-14T11:23:00.427178+0000","last_clean":"2023-10-14T11:23:00.427178+0000","last_became_active":"2023-10-14T11:22:57.606037+0000","last_became_peered":"2023-10-14T11:22:57.606037+0000","last_unstale":"2023-10-14T11:23:00.427178+0000","last_undegraded":"2023-10-14T11:23:00.427178+0000","last_fullsized":"2023-10-14T11:23:00.427178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618927+0000","last_change":"2023-10-14T11:22:58.620639+0000","last_active":"2023-10-14T11:22:59.618927+0000","last_peered":"2023-10-14T11:22:59.618927+0000","last_clean":"2023-10-14T11:22:59.618927+0000","last_became_active":"2023-10-14T11:22:58.620323+0000","last_became_peered":"2023-10-14T11:22:58.620323+0000","last_unstale":"2023-10-14T11:22:59.618927+0000","last_undegraded":"2023-10-14T11:22:59.618927+0000","last_fullsized":"2023-10-14T11:22:59.618927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427113+0000","last_change":"2023-10-14T11:22:57.604253+0000","last_active":"2023-10-14T11:23:00.427113+0000","last_peered":"2023-10-14T11:23:00.427113+0000","last_clean":"2023-10-14T11:23:00.427113+0000","last_became_active":"2023-10-14T11:22:57.603834+0000","last_became_peered":"2023-10-14T11:22:57.603834+0000","last_unstale":"2023-10-14T11:23:00.427113+0000","last_undegraded":"2023-10-14T11:23:00.427113+0000","last_fullsized":"2023-10-14T11:23:00.427113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427260+0000","last_change":"2023-10-14T11:22:58.637349+0000","last_active":"2023-10-14T11:23:00.427260+0000","last_peered":"2023-10-14T11:23:00.427260+0000","last_clean":"2023-10-14T11:23:00.427260+0000","last_became_active":"2023-10-14T11:22:58.636859+0000","last_became_peered":"2023-10-14T11:22:58.636859+0000","last_unstale":"2023-10-14T11:23:00.427260+0000","last_undegraded":"2023-10-14T11:23:00.427260+0000","last_fullsized":"2023-10-14T11:23:00.427260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617923+0000","last_change":"2023-10-14T11:22:57.603889+0000","last_active":"2023-10-14T11:22:59.617923+0000","last_peered":"2023-10-14T11:22:59.617923+0000","last_clean":"2023-10-14T11:22:59.617923+0000","last_became_active":"2023-10-14T11:22:57.603358+0000","last_became_peered":"2023-10-14T11:22:57.603358+0000","last_unstale":"2023-10-14T11:22:59.617923+0000","last_undegraded":"2023-10-14T11:22:59.617923+0000","last_fullsized":"2023-10-14T11:22:59.617923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618346+0000","last_change":"2023-10-14T11:22:58.635498+0000","last_active":"2023-10-14T11:22:59.618346+0000","last_peered":"2023-10-14T11:22:59.618346+0000","last_clean":"2023-10-14T11:22:59.618346+0000","last_became_active":"2023-10-14T11:22:58.635215+0000","last_became_peered":"2023-10-14T11:22:58.635215+0000","last_unstale":"2023-10-14T11:22:59.618346+0000","last_undegraded":"2023-10-14T11:22:59.618346+0000","last_fullsized":"2023-10-14T11:22:59.618346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427227+0000","last_change":"2023-10-14T11:22:57.606591+0000","last_active":"2023-10-14T11:23:00.427227+0000","last_peered":"2023-10-14T11:23:00.427227+0000","last_clean":"2023-10-14T11:23:00.427227+0000","last_became_active":"2023-10-14T11:22:57.606272+0000","last_became_peered":"2023-10-14T11:22:57.606272+0000","last_unstale":"2023-10-14T11:23:00.427227+0000","last_undegraded":"2023-10-14T11:23:00.427227+0000","last_fullsized":"2023-10-14T11:23:00.427227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:07.081725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427267+0000","last_change":"2023-10-14T11:22:58.624516+0000","last_active":"2023-10-14T11:23:00.427267+0000","last_peered":"2023-10-14T11:23:00.427267+0000","last_clean":"2023-10-14T11:23:00.427267+0000","last_became_active":"2023-10-14T11:22:58.624262+0000","last_became_peered":"2023-10-14T11:22:58.624262+0000","last_unstale":"2023-10-14T11:23:00.427267+0000","last_undegraded":"2023-10-14T11:23:00.427267+0000","last_fullsized":"2023-10-14T11:23:00.427267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:41.568935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619150+0000","last_change":"2023-10-14T11:22:58.615924+0000","last_active":"2023-10-14T11:22:59.619150+0000","last_peered":"2023-10-14T11:22:59.619150+0000","last_clean":"2023-10-14T11:22:59.619150+0000","last_became_active":"2023-10-14T11:22:58.615653+0000","last_became_peered":"2023-10-14T11:22:58.615653+0000","last_unstale":"2023-10-14T11:22:59.619150+0000","last_undegraded":"2023-10-14T11:22:59.619150+0000","last_fullsized":"2023-10-14T11:22:59.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426889+0000","last_change":"2023-10-14T11:22:58.634167+0000","last_active":"2023-10-14T11:23:00.426889+0000","last_peered":"2023-10-14T11:23:00.426889+0000","last_clean":"2023-10-14T11:23:00.426889+0000","last_became_active":"2023-10-14T11:22:58.633831+0000","last_became_peered":"2023-10-14T11:22:58.633831+0000","last_unstale":"2023-10-14T11:23:00.426889+0000","last_undegraded":"2023-10-14T11:23:00.426889+0000","last_fullsized":"2023-10-14T11:23:00.426889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618281+0000","last_change":"2023-10-14T11:22:58.632601+0000","last_active":"2023-10-14T11:22:59.618281+0000","last_peered":"2023-10-14T11:22:59.618281+0000","last_clean":"2023-10-14T11:22:59.618281+0000","last_became_active":"2023-10-14T11:22:58.631418+0000","last_became_peered":"2023-10-14T11:22:58.631418+0000","last_unstale":"2023-10-14T11:22:59.618281+0000","last_undegraded":"2023-10-14T11:22:59.618281+0000","last_fullsized":"2023-10-14T11:22:59.618281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203655+0000","last_change":"2023-10-14T11:22:58.622439+0000","last_active":"2023-10-14T11:23:00.203655+0000","last_peered":"2023-10-14T11:23:00.203655+0000","last_clean":"2023-10-14T11:23:00.203655+0000","last_became_active":"2023-10-14T11:22:58.621939+0000","last_became_peered":"2023-10-14T11:22:58.621939+0000","last_unstale":"2023-10-14T11:23:00.203655+0000","last_undegraded":"2023-10-14T11:23:00.203655+0000","last_fullsized":"2023-10-14T11:23:00.203655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427574+0000","last_change":"2023-10-14T11:22:58.626653+0000","last_active":"2023-10-14T11:23:00.427574+0000","last_peered":"2023-10-14T11:23:00.427574+0000","last_clean":"2023-10-14T11:23:00.427574+0000","last_became_active":"2023-10-14T11:22:58.626288+0000","last_became_peered":"2023-10-14T11:22:58.626288+0000","last_unstale":"2023-10-14T11:23:00.427574+0000","last_undegraded":"2023-10-14T11:23:00.427574+0000","last_fullsized":"2023-10-14T11:23:00.427574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617858+0000","last_change":"2023-10-14T11:22:58.621575+0000","last_active":"2023-10-14T11:22:59.617858+0000","last_peered":"2023-10-14T11:22:59.617858+0000","last_clean":"2023-10-14T11:22:59.617858+0000","last_became_active":"2023-10-14T11:22:58.621301+0000","last_became_peered":"2023-10-14T11:22:58.621301+0000","last_unstale":"2023-10-14T11:22:59.617858+0000","last_undegraded":"2023-10-14T11:22:59.617858+0000","last_fullsized":"2023-10-14T11:22:59.617858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619414+0000","last_change":"2023-10-14T11:22:58.617260+0000","last_active":"2023-10-14T11:22:59.619414+0000","last_peered":"2023-10-14T11:22:59.619414+0000","last_clean":"2023-10-14T11:22:59.619414+0000","last_became_active":"2023-10-14T11:22:58.616942+0000","last_became_peered":"2023-10-14T11:22:58.616942+0000","last_unstale":"2023-10-14T11:22:59.619414+0000","last_undegraded":"2023-10-14T11:22:59.619414+0000","last_fullsized":"2023-10-14T11:22:59.619414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427129+0000","last_change":"2023-10-14T11:22:58.625872+0000","last_active":"2023-10-14T11:23:00.427129+0000","last_peered":"2023-10-14T11:23:00.427129+0000","last_clean":"2023-10-14T11:23:00.427129+0000","last_became_active":"2023-10-14T11:22:58.625135+0000","last_became_peered":"2023-10-14T11:22:58.625135+0000","last_unstale":"2023-10-14T11:23:00.427129+0000","last_undegraded":"2023-10-14T11:23:00.427129+0000","last_fullsized":"2023-10-14T11:23:00.427129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618343+0000","last_change":"2023-10-14T11:22:58.632773+0000","last_active":"2023-10-14T11:22:59.618343+0000","last_peered":"2023-10-14T11:22:59.618343+0000","last_clean":"2023-10-14T11:22:59.618343+0000","last_became_active":"2023-10-14T11:22:58.632477+0000","last_became_peered":"2023-10-14T11:22:58.632477+0000","last_unstale":"2023-10-14T11:22:59.618343+0000","last_undegraded":"2023-10-14T11:22:59.618343+0000","last_fullsized":"2023-10-14T11:22:59.618343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426723+0000","last_change":"2023-10-14T11:22:58.626903+0000","last_active":"2023-10-14T11:23:00.426723+0000","last_peered":"2023-10-14T11:23:00.426723+0000","last_clean":"2023-10-14T11:23:00.426723+0000","last_became_active":"2023-10-14T11:22:58.625083+0000","last_became_peered":"2023-10-14T11:22:58.625083+0000","last_unstale":"2023-10-14T11:23:00.426723+0000","last_undegraded":"2023-10-14T11:23:00.426723+0000","last_fullsized":"2023-10-14T11:23:00.426723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618096+0000","last_change":"2023-10-14T11:22:58.631322+0000","last_active":"2023-10-14T11:22:59.618096+0000","last_peered":"2023-10-14T11:22:59.618096+0000","last_clean":"2023-10-14T11:22:59.618096+0000","last_became_active":"2023-10-14T11:22:58.631036+0000","last_became_peered":"2023-10-14T11:22:58.631036+0000","last_unstale":"2023-10-14T11:22:59.618096+0000","last_undegraded":"2023-10-14T11:22:59.618096+0000","last_fullsized":"2023-10-14T11:22:59.618096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203634+0000","last_change":"2023-10-14T11:22:58.622242+0000","last_active":"2023-10-14T11:23:00.203634+0000","last_peered":"2023-10-14T11:23:00.203634+0000","last_clean":"2023-10-14T11:23:00.203634+0000","last_became_active":"2023-10-14T11:22:58.621364+0000","last_became_peered":"2023-10-14T11:22:58.621364+0000","last_unstale":"2023-10-14T11:23:00.203634+0000","last_undegraded":"2023-10-14T11:23:00.203634+0000","last_fullsized":"2023-10-14T11:23:00.203634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619405+0000","last_change":"2023-10-14T11:22:58.624828+0000","last_active":"2023-10-14T11:22:59.619405+0000","last_peered":"2023-10-14T11:22:59.619405+0000","last_clean":"2023-10-14T11:22:59.619405+0000","last_became_active":"2023-10-14T11:22:58.624570+0000","last_became_peered":"2023-10-14T11:22:58.624570+0000","last_unstale":"2023-10-14T11:22:59.619405+0000","last_undegraded":"2023-10-14T11:22:59.619405+0000","last_fullsized":"2023-10-14T11:22:59.619405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:03.156 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T11:23:03.157 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T11:23:03.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T11:23:03.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T11:23:03.158 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T11:23:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.313+0000 7f7a436f8700 1 Processor -- start 2023-10-14T11:23:03.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.313+0000 7f7a436f8700 1 -- start start 2023-10-14T11:23:03.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a436f8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 0x7f7a3c0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a436f8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a436f8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3c0cf300 con 0x7f7a3c15a600 2023-10-14T11:23:03.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a436f8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0cf720 con 0x7f7a3c0ce960 2023-10-14T11:23:03.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a436f8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c06d0b0 con 0x7f7a3c0cc1f0 2023-10-14T11:23:03.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41280/0 (socket says 172.21.15.67:41280) 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41494700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7a3c15a600 0x7f7a3c06e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40570/0 (socket says 172.21.15.67:40570) 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 -- 172.21.15.67:0/2936987466 learned_addr learned my addr 172.21.15.67:0/2936987466 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a40c93700 1 --2- 172.21.15.67:0/2936987466 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 0x7f7a3c0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 -- 172.21.15.67:0/2936987466 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 msgr2=0x7f7a3c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:03.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 --2- 172.21.15.67:0/2936987466 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 0x7f7a3c0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 -- 172.21.15.67:0/2936987466 >> v1:172.21.15.67:6789/0 conn(0x7f7a3c15a600 legacy=0x7f7a3c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 -- 172.21.15.67:0/2936987466 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c06d390 con 0x7f7a3c0ce960 2023-10-14T11:23:03.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a40c93700 1 --2- 172.21.15.67:0/2936987466 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 0x7f7a3c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:03.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a41c95700 1 --2- 172.21.15.67:0/2936987466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0b5d70 tx=0x7f7a3400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cae32de0e8a7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a33fff700 1 -- 172.21.15.67:0/2936987466 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34010070 con 0x7f7a3c0ce960 2023-10-14T11:23:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.314+0000 7f7a33fff700 1 -- 172.21.15.67:0/2936987466 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400dd90 con 0x7f7a3c0ce960 2023-10-14T11:23:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a33fff700 1 -- 172.21.15.67:0/2936987466 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400b310 con 0x7f7a3c0ce960 2023-10-14T11:23:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 -- 172.21.15.67:0/2936987466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c0ce960 msgr2=0x7f7a3c0cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2936987466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0b5d70 tx=0x7f7a3400d430 comp rx=0 tx=0).stop 2023-10-14T11:23:03.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 -- 172.21.15.67:0/2936987466 shutdown_connections 2023-10-14T11:23:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2936987466 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c0ce960 0x7f7a3c0cedc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2936987466 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c0cc1f0 0x7f7a3c0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 -- 172.21.15.67:0/2936987466 >> 172.21.15.67:0/2936987466 conn(0x7f7a3c0b16f0 msgr2=0x7f7a3c0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 -- 172.21.15.67:0/2936987466 shutdown_connections 2023-10-14T11:23:03.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.315+0000 7f7a436f8700 1 -- 172.21.15.67:0/2936987466 wait complete. 2023-10-14T11:23:03.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.316+0000 7f7a436f8700 1 Processor -- start 2023-10-14T11:23:03.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.316+0000 7f7a436f8700 1 -- start start 2023-10-14T11:23:03.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0cc1f0 0x7f7a3c0c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 0x7f7a3c0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0c4170 con 0x7f7a3c15a600 2023-10-14T11:23:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c1f2890 con 0x7f7a3c0cc1f0 2023-10-14T11:23:03.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a436f8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0b5160 con 0x7f7a3c0ce960 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a41c95700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a41c95700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41286/0 (socket says 172.21.15.67:41286) 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a41c95700 1 -- 172.21.15.67:0/2187198260 learned_addr learned my addr 172.21.15.67:0/2187198260 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a41494700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0cc1f0 0x7f7a3c0c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.317+0000 7f7a40c93700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 0x7f7a3c0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 -- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 msgr2=0x7f7a3c0c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 0x7f7a3c0c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 -- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0cc1f0 msgr2=0x7f7a3c0c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0cc1f0 0x7f7a3c0c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 -- 172.21.15.67:0/2187198260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3400bd40 con 0x7f7a3c15a600 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a40c93700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 0x7f7a3c0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:03.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a41c95700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0730b0 tx=0x7f7a34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400b4c0 con 0x7f7a3c15a600 2023-10-14T11:23:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400adb0 con 0x7f7a3c15a600 2023-10-14T11:23:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c0c43c0 con 0x7f7a3c15a600 2023-10-14T11:23:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34004280 con 0x7f7a3c15a600 2023-10-14T11:23:03.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.318+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c1f2520 con 0x7f7a3c15a600 2023-10-14T11:23:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.319+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c1f2a00 con 0x7f7a3c15a600 2023-10-14T11:23:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.320+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a340043e0 con 0x7f7a3c15a600 2023-10-14T11:23:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.320+0000 7f7a31ffb700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 0x7f7a2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.320+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a3408d180 con 0x7f7a3c15a600 2023-10-14T11:23:03.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.320+0000 7f7a41494700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 0x7f7a2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.321+0000 7f7a41494700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 0x7f7a2006d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f60 tx=0x7f7a38007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.324+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7a340582c0 con 0x7f7a3c15a600 2023-10-14T11:23:03.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.583+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7a3c04ebb0 con 0x7f7a3c15a600 2023-10-14T11:23:03.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.587+0000 7f7a31ffb700 1 -- 172.21.15.67:0/2187198260 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171029 (secure 0 0 0) 0x7f7a3405b8e0 con 0x7f7a3c15a600 2023-10-14T11:23:03.591 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 msgr2=0x7f7a2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 0x7f7a2006d3c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f60 tx=0x7f7a38007d10 comp rx=0 tx=0).stop 2023-10-14T11:23:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 msgr2=0x7f7a3c0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0730b0 tx=0x7f7a34004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 shutdown_connections 2023-10-14T11:23:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7a2006af00 0x7f7a2006d3c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7a3c15a600 0x7f7a3c0b4c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0cc1f0 0x7f7a3c0c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 --2- 172.21.15.67:0/2187198260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7a3c0ce960 0x7f7a3c0c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 >> 172.21.15.67:0/2187198260 conn(0x7f7a3c0b16f0 msgr2=0x7f7a3c156e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:03.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 shutdown_connections 2023-10-14T11:23:03.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.589+0000 7f7a436f8700 1 -- 172.21.15.67:0/2187198260 wait complete. 2023-10-14T11:23:03.603 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":3280464453},{"type":"v1","addr":"172.21.15.72:6833","nonce":3280464453}]},"active_addr":"172.21.15.72:6833/3280464453","active_change":"2023-10-14T11:22:46.389569+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1569074560}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":200465164}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":3776669583}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2294295691}]}]} 2023-10-14T11:23:03.607 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T11:23:03.607 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T11:23:03.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:03.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.731+0000 7f776851a700 1 Processor -- start 2023-10-14T11:23:03.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.731+0000 7f776851a700 1 -- start start 2023-10-14T11:23:03.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f776851a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 0x7f7760072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f776851a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77600c52c0 0x7f77600c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f776851a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7760072ac0 con 0x7f776015e4a0 2023-10-14T11:23:03.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f776851a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600cfa80 con 0x7f77600c52c0 2023-10-14T11:23:03.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f776851a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600cfd60 con 0x7f776015e0c0 2023-10-14T11:23:03.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f7765ab5700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f776015e4a0 0x7f77600cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40586/0 (socket says 172.21.15.67:40586) 2023-10-14T11:23:03.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f7765ab5700 1 -- 172.21.15.67:0/2151000015 learned_addr learned my addr 172.21.15.67:0/2151000015 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:03.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77662b6700 1 --2- 172.21.15.67:0/2151000015 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 0x7f7760072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f7766ab7700 1 --2- 172.21.15.67:0/2151000015 >> v2:172.21.15.72:3300/0 conn(0x7f77600c52c0 0x7f77600c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186083310 0 0) 0x7f7760072ac0 con 0x7f776015e4a0 2023-10-14T11:23:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f774c0035b0 con 0x7f776015e4a0 2023-10-14T11:23:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2067601954 0 0) 0x7f774c0035b0 con 0x7f776015e4a0 2023-10-14T11:23:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77662b6700 1 -- 172.21.15.67:0/2151000015 >> v2:172.21.15.72:3300/0 conn(0x7f77600c52c0 msgr2=0x7f77600c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:03.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77662b6700 1 --2- 172.21.15.67:0/2151000015 >> v2:172.21.15.72:3300/0 conn(0x7f77600c52c0 0x7f77600c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77662b6700 1 -- 172.21.15.67:0/2151000015 >> v1:172.21.15.67:6789/0 conn(0x7f776015e4a0 legacy=0x7f77600cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.732+0000 7f77662b6700 1 -- 172.21.15.67:0/2151000015 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77600d0040 con 0x7f776015e0c0 2023-10-14T11:23:03.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f77662b6700 1 --2- 172.21.15.67:0/2151000015 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 0x7f7760072580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f775c009840 tx=0x7f775c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf922c2bacde1a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750001670 con 0x7f776015e0c0 2023-10-14T11:23:03.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c004030 con 0x7f776015e0c0 2023-10-14T11:23:03.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f77652b4700 1 -- 172.21.15.67:0/2151000015 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c0043c0 con 0x7f776015e0c0 2023-10-14T11:23:03.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 -- 172.21.15.67:0/2151000015 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 msgr2=0x7f7760072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 --2- 172.21.15.67:0/2151000015 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 0x7f7760072580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f775c009840 tx=0x7f775c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 -- 172.21.15.67:0/2151000015 shutdown_connections 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 --2- 172.21.15.67:0/2151000015 >> v2:172.21.15.72:3300/0 conn(0x7f77600c52c0 0x7f77600c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 --2- 172.21.15.67:0/2151000015 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f776015e0c0 0x7f7760072580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 -- 172.21.15.67:0/2151000015 >> 172.21.15.67:0/2151000015 conn(0x7f77600d0440 msgr2=0x7f77600d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 -- 172.21.15.67:0/2151000015 shutdown_connections 2023-10-14T11:23:03.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.733+0000 7f776851a700 1 -- 172.21.15.67:0/2151000015 wait complete. 2023-10-14T11:23:03.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.734+0000 7f776851a700 1 Processor -- start 2023-10-14T11:23:03.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 -- start start 2023-10-14T11:23:03.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77600c52c0 0x7f77600aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f776015e4a0 0x7f7760153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600af140 con 0x7f776015e0c0 2023-10-14T11:23:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600c8900 con 0x7f776015e4a0 2023-10-14T11:23:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f776851a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600c8be0 con 0x7f77600c52c0 2023-10-14T11:23:03.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f7765ab5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f7765ab5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41298/0 (socket says 172.21.15.67:41298) 2023-10-14T11:23:03.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.735+0000 7f7765ab5700 1 -- 172.21.15.67:0/1711806027 learned_addr learned my addr 172.21.15.67:0/1711806027 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:03.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7766ab7700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f776015e4a0 0x7f7760153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f77662b6700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77600c52c0 0x7f77600aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 -- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77600c52c0 msgr2=0x7f77600aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77600c52c0 0x7f77600aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 -- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f776015e4a0 msgr2=0x7f7760153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f776015e4a0 0x7f7760153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 -- 172.21.15.67:0/1711806027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0094a0 con 0x7f776015e0c0 2023-10-14T11:23:03.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7765ab5700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f775000c750 tx=0x7f775000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750004c80 con 0x7f776015e0c0 2023-10-14T11:23:03.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7750004de0 con 0x7f776015e0c0 2023-10-14T11:23:03.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600c8ec0 con 0x7f776015e0c0 2023-10-14T11:23:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77500072d0 con 0x7f776015e0c0 2023-10-14T11:23:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.736+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600c9480 con 0x7f776015e0c0 2023-10-14T11:23:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.737+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77601f0c70 con 0x7f776015e0c0 2023-10-14T11:23:03.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.738+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7750007430 con 0x7f776015e0c0 2023-10-14T11:23:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.738+0000 7f7756ffd700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 0x7f774406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.738+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7750089340 con 0x7f776015e0c0 2023-10-14T11:23:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.738+0000 7f77662b6700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 0x7f774406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.739+0000 7f77662b6700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 0x7f774406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f775c0090b0 tx=0x7f775c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:03.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.743+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7750054370 con 0x7f776015e0c0 2023-10-14T11:23:03.827 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:23:03.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:23:03.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.949+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f776004ebb0 con 0x7f776015e0c0 2023-10-14T11:23:03.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.950+0000 7f7756ffd700 1 -- 172.21.15.67:0/1711806027 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f7750057990 con 0x7f776015e0c0 2023-10-14T11:23:03.952 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:03.953 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:03.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 msgr2=0x7f774406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 0x7f774406d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f775c0090b0 tx=0x7f775c008030 comp rx=0 tx=0).stop 2023-10-14T11:23:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 msgr2=0x7f77600c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f775000c750 tx=0x7f775000ca60 comp rx=0 tx=0).stop 2023-10-14T11:23:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 shutdown_connections 2023-10-14T11:23:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f776015e4a0 0x7f7760153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77600c52c0 0x7f77600aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f774406af00 0x7f774406d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 --2- 172.21.15.67:0/1711806027 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f776015e0c0 0x7f77600c7f20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 >> 172.21.15.67:0/1711806027 conn(0x7f77600d0440 msgr2=0x7f776006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 shutdown_connections 2023-10-14T11:23:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:03.952+0000 7f776851a700 1 -- 172.21.15.67:0/1711806027 wait complete. 2023-10-14T11:23:03.966 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T11:23:03.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.090+0000 7fcd6541d700 1 Processor -- start 2023-10-14T11:23:04.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.090+0000 7fcd6541d700 1 -- start start 2023-10-14T11:23:04.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd6541d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd601610f0 0x7fcd601617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd6541d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcd60161d10 0x7fcd60162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd6541d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd600ce360 con 0x7fcd600ce840 2023-10-14T11:23:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd6541d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600d00c0 con 0x7fcd601610f0 2023-10-14T11:23:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd6541d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600d03a0 con 0x7fcd60161d10 2023-10-14T11:23:04.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fcd601610f0 0x7fcd601617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5f7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fcd600ce840 0x7fcd600cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40602/0 (socket says 172.21.15.67:40602) 2023-10-14T11:23:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5f7fe700 1 -- 172.21.15.67:0/3928126321 learned_addr learned my addr 172.21.15.67:0/3928126321 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 -- 172.21.15.67:0/3928126321 >> v2:172.21.15.72:3300/0 conn(0x7fcd60161d10 msgr2=0x7fcd60162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 --2- 172.21.15.67:0/3928126321 >> v2:172.21.15.72:3300/0 conn(0x7fcd60161d10 0x7fcd60162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 -- 172.21.15.67:0/3928126321 >> v1:172.21.15.67:6789/0 conn(0x7fcd600ce840 legacy=0x7fcd600cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5dffb700 1 -- 172.21.15.67:0/3928126321 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800871555 0 0) 0x7fcd600ce360 con 0x7fcd600ce840 2023-10-14T11:23:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 -- 172.21.15.67:0/3928126321 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd600d0680 con 0x7fcd601610f0 2023-10-14T11:23:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.091+0000 7fcd5effd700 1 --2- 172.21.15.67:0/3928126321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd601610f0 0x7fcd601617d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd600cfd50 tx=0x7fcd50009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55a77409730378a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd5dffb700 1 -- 172.21.15.67:0/3928126321 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50005e30 con 0x7fcd601610f0 2023-10-14T11:23:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd5dffb700 1 -- 172.21.15.67:0/3928126321 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50006030 con 0x7fcd601610f0 2023-10-14T11:23:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd5dffb700 1 -- 172.21.15.67:0/3928126321 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500063c0 con 0x7fcd601610f0 2023-10-14T11:23:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 -- 172.21.15.67:0/3928126321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd601610f0 msgr2=0x7fcd601617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 --2- 172.21.15.67:0/3928126321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd601610f0 0x7fcd601617d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcd600cfd50 tx=0x7fcd50009b00 comp rx=0 tx=0).stop 2023-10-14T11:23:04.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 -- 172.21.15.67:0/3928126321 shutdown_connections 2023-10-14T11:23:04.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 --2- 172.21.15.67:0/3928126321 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd601610f0 0x7fcd601617d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 --2- 172.21.15.67:0/3928126321 >> v2:172.21.15.72:3300/0 conn(0x7fcd60161d10 0x7fcd60162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 -- 172.21.15.67:0/3928126321 >> 172.21.15.67:0/3928126321 conn(0x7fcd6009cab0 msgr2=0x7fcd600d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 -- 172.21.15.67:0/3928126321 shutdown_connections 2023-10-14T11:23:04.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.092+0000 7fcd6541d700 1 -- 172.21.15.67:0/3928126321 wait complete. 2023-10-14T11:23:04.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.093+0000 7fcd6541d700 1 Processor -- start 2023-10-14T11:23:04.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 -- start start 2023-10-14T11:23:04.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd601610f0 0x7fcd601f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd60161d10 0x7fcd6015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600cbe00 con 0x7fcd600ce840 2023-10-14T11:23:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd600cb970 con 0x7fcd601610f0 2023-10-14T11:23:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd6541d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd60155190 con 0x7fcd60161d10 2023-10-14T11:23:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd5effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd5effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41310/0 (socket says 172.21.15.67:41310) 2023-10-14T11:23:04.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.094+0000 7fcd5effd700 1 -- 172.21.15.67:0/815129446 learned_addr learned my addr 172.21.15.67:0/815129446 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5e7fc700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd601610f0 0x7fcd601f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5f7fe700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd60161d10 0x7fcd6015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 -- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd60161d10 msgr2=0x7fcd6015d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd60161d10 0x7fcd6015d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 -- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd601610f0 msgr2=0x7fcd601f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd601610f0 0x7fcd601f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 -- 172.21.15.67:0/815129446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009430 con 0x7fcd600ce840 2023-10-14T11:23:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd5effd700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd6008dc50 tx=0x7fcd50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50004240 con 0x7fcd600ce840 2023-10-14T11:23:04.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500043c0 con 0x7fcd600ce840 2023-10-14T11:23:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd601f75b0 con 0x7fcd600ce840 2023-10-14T11:23:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500036a0 con 0x7fcd600ce840 2023-10-14T11:23:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.095+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd600cb040 con 0x7fcd600ce840 2023-10-14T11:23:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.096+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60066970 con 0x7fcd600ce840 2023-10-14T11:23:04.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.096+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcd50022070 con 0x7fcd600ce840 2023-10-14T11:23:04.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.097+0000 7fcd477fe700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 0x7fcd4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.097+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd5008af30 con 0x7fcd600ce840 2023-10-14T11:23:04.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.097+0000 7fcd5e7fc700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 0x7fcd4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.097+0000 7fcd5e7fc700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 0x7fcd4c06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006fd0 tx=0x7fcd54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.101+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcd50056070 con 0x7fcd600ce840 2023-10-14T11:23:04.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.301+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd6004ebb0 con 0x7fcd600ce840 2023-10-14T11:23:04.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.303+0000 7fcd477fe700 1 -- 172.21.15.67:0/815129446 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fcd50059690 con 0x7fcd600ce840 2023-10-14T11:23:04.305 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:04.305 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 msgr2=0x7fcd4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 0x7fcd4c06d3c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd54006fd0 tx=0x7fcd54008040 comp rx=0 tx=0).stop 2023-10-14T11:23:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 msgr2=0x7fcd60154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd6008dc50 tx=0x7fcd50004750 comp rx=0 tx=0).stop 2023-10-14T11:23:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 shutdown_connections 2023-10-14T11:23:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fcd60161d10 0x7fcd6015d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fcd4c06af00 0x7fcd4c06d3c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fcd600ce840 0x7fcd60154c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 --2- 172.21.15.67:0/815129446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcd601610f0 0x7fcd601f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 >> 172.21.15.67:0/815129446 conn(0x7fcd6009cab0 msgr2=0x7fcd60160420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 shutdown_connections 2023-10-14T11:23:04.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.305+0000 7fcd6541d700 1 -- 172.21.15.67:0/815129446 wait complete. 2023-10-14T11:23:04.319 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T11:23:04.320 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T11:23:04.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T11:23:04.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T11:23:04.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T11:23:04.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T11:23:04.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T11:23:04.323 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T11:23:04.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.535+0000 7f5eff655700 1 Processor -- start 2023-10-14T11:23:04.538 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.536+0000 7f5eff655700 1 -- start start 2023-10-14T11:23:04.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.537+0000 7f5eff655700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef8162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.537+0000 7f5eff655700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef806a810 0x7f5ef806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.537+0000 7f5eff655700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef81617c0 con 0x7f5ef815dde0 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.537+0000 7f5eff655700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef806b1e0 con 0x7f5ef806a810 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.537+0000 7f5eff655700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80cdf90 con 0x7f5ef815da00 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef806a810 0x7f5ef806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ef806a810 0x7f5ef806aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41726/0 (socket says 172.21.15.67:41726) 2023-10-14T11:23:04.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 -- 172.21.15.67:0/430768518 learned_addr learned my addr 172.21.15.67:0/430768518 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 -- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 msgr2=0x7f5ef8162230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:04.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 --2- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef8162230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 -- 172.21.15.67:0/430768518 >> v1:172.21.15.67:6789/0 conn(0x7f5ef815dde0 legacy=0x7f5ef80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 -- 172.21.15.67:0/430768518 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8161a30 con 0x7f5ef806a810 2023-10-14T11:23:04.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5efdbf2700 1 --2- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 0x7f5ef806aca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009e50 tx=0x7f5ef000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=472779364470fb31 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5eebfff700 1 -- 172.21.15.67:0/430768518 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000e070 con 0x7f5ef806a810 2023-10-14T11:23:04.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5eebfff700 1 -- 172.21.15.67:0/430768518 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0003a20 con 0x7f5ef806a810 2023-10-14T11:23:04.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.538+0000 7f5eebfff700 1 -- 172.21.15.67:0/430768518 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0003dd0 con 0x7f5ef806a810 2023-10-14T11:23:04.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.539+0000 7f5eff655700 1 -- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 msgr2=0x7f5ef806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.539+0000 7f5eff655700 1 --2- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 0x7f5ef806aca0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009e50 tx=0x7f5ef000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:04.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f050d1bd700 1 Processor -- start 2023-10-14T11:23:04.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f050d1bd700 1 -- start start 2023-10-14T11:23:04.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f5eff655700 1 -- 172.21.15.67:0/430768518 shutdown_connections 2023-10-14T11:23:04.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f5eff655700 1 --2- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 0x7f5ef806aca0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f5eff655700 1 --2- 172.21.15.67:0/430768518 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef8162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.540+0000 7f5eff655700 1 -- 172.21.15.67:0/430768518 >> 172.21.15.67:0/430768518 conn(0x7f5ef80cbeb0 msgr2=0x7f5ef80cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.541+0000 7f5eff655700 1 -- 172.21.15.67:0/430768518 shutdown_connections 2023-10-14T11:23:04.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f050d1bd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f050806a810 0x7f050806abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f050d1bd700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050806b130 con 0x7f050806e410 2023-10-14T11:23:04.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f050d1bd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080cbca0 con 0x7f05080ca2b0 2023-10-14T11:23:04.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f050d1bd700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050815cd10 con 0x7f050806a810 2023-10-14T11:23:04.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f050806a810 0x7f050806abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f050806a810 0x7f050806abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41322/0 (socket says 172.21.15.67:41322) 2023-10-14T11:23:04.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 -- 172.21.15.67:0/3057995452 learned_addr learned my addr 172.21.15.67:0/3057995452 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 -- 172.21.15.67:0/3057995452 >> v1:172.21.15.72:6789/0 conn(0x7f05080ca2b0 legacy=0x7f05080ca6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:04.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 -- 172.21.15.67:0/3057995452 >> v1:172.21.15.67:6789/0 conn(0x7f050806e410 legacy=0x7f05080cb590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:04.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.542+0000 7f0506d9d700 1 -- 172.21.15.67:0/3057995452 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050815c190 con 0x7f050806a810 2023-10-14T11:23:04.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.543+0000 7f0506d9d700 1 --2- 172.21.15.67:0/3057995452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806a810 0x7f050806abf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0500009e50 tx=0x7f050000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5c1881892bc4d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.543+0000 7f5eff655700 1 -- 172.21.15.67:0/430768518 wait complete. 2023-10-14T11:23:04.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.544+0000 7f0505d9b700 1 -- 172.21.15.67:0/3057995452 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050000e070 con 0x7f050806a810 2023-10-14T11:23:04.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.544+0000 7f0505d9b700 1 -- 172.21.15.67:0/3057995452 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500003a20 con 0x7f050806a810 2023-10-14T11:23:04.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.544+0000 7f0505d9b700 1 -- 172.21.15.67:0/3057995452 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500003dd0 con 0x7f050806a810 2023-10-14T11:23:04.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.544+0000 7fec20921700 1 Processor -- start 2023-10-14T11:23:04.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.545+0000 7f5eff655700 1 Processor -- start 2023-10-14T11:23:04.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.545+0000 7f050d1bd700 1 -- 172.21.15.67:0/3057995452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806a810 msgr2=0x7f050806abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.545+0000 7f050d1bd700 1 --2- 172.21.15.67:0/3057995452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806a810 0x7f050806abf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0500009e50 tx=0x7f050000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.545+0000 7fc3461df700 1 Processor -- start 2023-10-14T11:23:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.544+0000 7fec20921700 1 -- start start 2023-10-14T11:23:04.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.545+0000 7fc3461df700 1 -- start start 2023-10-14T11:23:04.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec20921700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec1c1597a0 0x7fec1c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec20921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c0cc9a0 0x7fec1c06a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec20921700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c15d590 con 0x7fec1c072520 2023-10-14T11:23:04.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec20921700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c15d870 con 0x7fec1c1597a0 2023-10-14T11:23:04.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec20921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c15db50 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec1a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec1c1597a0 0x7fec1c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec1a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fec1c1597a0 0x7fec1c0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41328/0 (socket says 172.21.15.67:41328) 2023-10-14T11:23:04.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7fec1a59c700 1 -- 172.21.15.67:0/1712628800 learned_addr learned my addr 172.21.15.67:0/1712628800 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc3461df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc34006af20 0x7fc3400c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc3461df700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34015d870 con 0x7fc3400cc9a0 2023-10-14T11:23:04.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc3461df700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34015db50 con 0x7fc340072520 2023-10-14T11:23:04.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc3461df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3401608b0 con 0x7fc34006af20 2023-10-14T11:23:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7f5eff655700 1 -- start start 2023-10-14T11:23:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7f050d1bd700 1 -- 172.21.15.67:0/3057995452 shutdown_connections 2023-10-14T11:23:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7f050d1bd700 1 --2- 172.21.15.67:0/3057995452 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806a810 0x7f050806abf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.546+0000 7f050d1bd700 1 -- 172.21.15.67:0/3057995452 >> 172.21.15.67:0/3057995452 conn(0x7f05080cbeb0 msgr2=0x7f05080cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fec1a59c700 1 -- 172.21.15.67:0/1712628800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c0cc9a0 msgr2=0x7fec1c06a810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fec1a59c700 1 --2- 172.21.15.67:0/1712628800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c0cc9a0 0x7fec1c06a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fec1a59c700 1 -- 172.21.15.67:0/1712628800 >> v1:172.21.15.72:6789/0 conn(0x7fec1c072520 legacy=0x7fec1c06e410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fec1a59c700 1 -- 172.21.15.67:0/1712628800 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c15de30 con 0x7fec1c1597a0 2023-10-14T11:23:04.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc33f7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc3400cc9a0 0x7fc3401595c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40628/0 (socket says 172.21.15.67:40628) 2023-10-14T11:23:04.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2232948946 learned_addr learned my addr 172.21.15.67:0/2232948946 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 0x7f5ef8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef80b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 0x7f5ef80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8159440 con 0x7f5ef815dde0 2023-10-14T11:23:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81f7750 con 0x7f5ef806a810 2023-10-14T11:23:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5eff655700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef81f6860 con 0x7f5ef815da00 2023-10-14T11:23:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5efdbf2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 0x7f5ef80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5efdbf2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 0x7f5ef80b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41336/0 (socket says 172.21.15.67:41336) 2023-10-14T11:23:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5efdbf2700 1 -- 172.21.15.67:0/2173248694 learned_addr learned my addr 172.21.15.67:0/2173248694 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422798901 0 0) 0x7fc34015d870 con 0x7fc3400cc9a0 2023-10-14T11:23:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3280035b0 con 0x7fc3400cc9a0 2023-10-14T11:23:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.547+0000 7f5efcbf0700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef80b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fec1a59c700 1 --2- 172.21.15.67:0/1712628800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c1597a0 0x7fec1c0c9a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec10014500 tx=0x7fec10014810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b372678d6c5f28 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 -- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 msgr2=0x7f5ef80b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef80b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 -- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 msgr2=0x7f5ef8158f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:23:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1389785490 0 0) 0x7fc3280035b0 con 0x7fc3400cc9a0 2023-10-14T11:23:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef806a810 0x7f5ef8158f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 -- 172.21.15.67:0/2173248694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef0009b30 con 0x7f5ef815dde0 2023-10-14T11:23:04.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efcbf0700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ef815da00 0x7f5ef80b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:04.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 >> v2:172.21.15.72:3300/0 conn(0x7fc34006af20 msgr2=0x7fc3400c9a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 --2- 172.21.15.67:0/2232948946 >> v2:172.21.15.72:3300/0 conn(0x7fc34006af20 0x7fc3400c9a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 >> v1:172.21.15.72:6789/0 conn(0x7fc340072520 legacy=0x7fc34006a810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34015de30 con 0x7fc3400cc9a0 2023-10-14T11:23:04.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7fc334001670 con 0x7fc3400cc9a0 2023-10-14T11:23:04.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fec1959a700 1 -- 172.21.15.67:0/1712628800 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10004230 con 0x7fec1c1597a0 2023-10-14T11:23:04.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fec1959a700 1 -- 172.21.15.67:0/1712628800 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10004390 con 0x7fec1c1597a0 2023-10-14T11:23:04.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fec1959a700 1 -- 172.21.15.67:0/1712628800 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec100036a0 con 0x7fec1c1597a0 2023-10-14T11:23:04.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 >> v1:172.21.15.67:6789/0 conn(0x7fc3400cc9a0 legacy=0x7fc3401595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 0x7fc328003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328004850 0x7fc328004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc328005280 0x7fc32800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401608b0 con 0x7fc328003a00 2023-10-14T11:23:04.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32800c1d0 con 0x7fc328005280 2023-10-14T11:23:04.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32800c390 con 0x7fc328004850 2023-10-14T11:23:04.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7f5efdbf2700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 0x7f5ef80b08e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ef806f560 tx=0x7f5ef0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.548+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 0x7fc328003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004440 con 0x7f5ef815dde0 2023-10-14T11:23:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef00045a0 con 0x7f5ef815dde0 2023-10-14T11:23:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0004950 con 0x7f5ef815dde0 2023-10-14T11:23:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef81f6b40 con 0x7f5ef815dde0 2023-10-14T11:23:04.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef81f7100 con 0x7f5ef815dde0 2023-10-14T11:23:04.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fec20921700 1 -- 172.21.15.67:0/1712628800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c1597a0 msgr2=0x7fec1c0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fec20921700 1 --2- 172.21.15.67:0/1712628800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c1597a0 0x7fec1c0c9a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fec10014500 tx=0x7fec10014810 comp rx=0 tx=0).stop 2023-10-14T11:23:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328004850 msgr2=0x7fc328004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328004850 0x7fc328004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc328005280 msgr2=0x7fc32800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:04.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc328005280 0x7fc32800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2232948946 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34015de30 con 0x7fc328003a00 2023-10-14T11:23:04.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 0x7fc328003e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c3f0 tx=0x7fc328005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b7f3d426f44f10 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.549+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334005960 con 0x7fc328003a00 2023-10-14T11:23:04.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334005ac0 con 0x7fc328003a00 2023-10-14T11:23:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fc33e7fc700 1 -- 172.21.15.67:0/2232948946 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334005e50 con 0x7fc328003a00 2023-10-14T11:23:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fc33ffff700 1 -- 172.21.15.67:0/2232948946 reap_dead start 2023-10-14T11:23:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fec20921700 1 -- 172.21.15.67:0/1712628800 shutdown_connections 2023-10-14T11:23:04.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fec20921700 1 --2- 172.21.15.67:0/1712628800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c1597a0 0x7fec1c0c9a80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fec20921700 1 --2- 172.21.15.67:0/1712628800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c0cc9a0 0x7fec1c06a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fec20921700 1 -- 172.21.15.67:0/1712628800 >> 172.21.15.67:0/1712628800 conn(0x7fec1c0cbeb0 msgr2=0x7fec1c0cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7f050d1bd700 1 -- 172.21.15.67:0/3057995452 shutdown_connections 2023-10-14T11:23:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7f050d1bd700 1 -- 172.21.15.67:0/3057995452 wait complete. 2023-10-14T11:23:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fc3461df700 1 -- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 msgr2=0x7fc328003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.550+0000 7fc3461df700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 0x7fc328003e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c3f0 tx=0x7fc328005880 comp rx=0 tx=0).stop 2023-10-14T11:23:04.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.551+0000 7fc3461df700 1 -- 172.21.15.67:0/2232948946 shutdown_connections 2023-10-14T11:23:04.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.551+0000 7fc3461df700 1 --2- 172.21.15.67:0/2232948946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc328003a00 0x7fc328003e00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.551+0000 7fc3461df700 1 -- 172.21.15.67:0/2232948946 >> 172.21.15.67:0/2232948946 conn(0x7fc3400cbeb0 msgr2=0x7fc3400cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.551+0000 7fec20921700 1 -- 172.21.15.67:0/1712628800 shutdown_connections 2023-10-14T11:23:04.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.551+0000 7fec20921700 1 -- 172.21.15.67:0/1712628800 wait complete. 2023-10-14T11:23:04.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ef0012430 con 0x7f5ef815dde0 2023-10-14T11:23:04.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7fec20921700 1 Processor -- start 2023-10-14T11:23:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7f050d1bd700 1 Processor -- start 2023-10-14T11:23:04.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7f050d1bd700 1 -- start start 2023-10-14T11:23:04.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7f5ee9ffb700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5edc06aed0 0x7f5edc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.552+0000 7fec20921700 1 -- start start 2023-10-14T11:23:04.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ef008ac50 con 0x7f5ef815dde0 2023-10-14T11:23:04.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7f5efd3f1700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5edc06aed0 0x7f5edc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 0x7fec1c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c0cc9a0 0x7fec1c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1c1597a0 0x7fec1c0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c4b50 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0b4480 con 0x7fec1c1597a0 2023-10-14T11:23:04.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec20921700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c154ef0 con 0x7fec1c072520 2023-10-14T11:23:04.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec1a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 0x7fec1c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec1a59c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 0x7fec1c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43618/0 (socket says 172.21.15.67:43618) 2023-10-14T11:23:04.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.553+0000 7fec1a59c700 1 -- 172.21.15.67:0/1960297331 learned_addr learned my addr 172.21.15.67:0/1960297331 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c0cc9a0 0x7fec1c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 0x7f0508146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fc3461df700 1 -- 172.21.15.67:0/2232948946 shutdown_connections 2023-10-14T11:23:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806e410 0x7f05080c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080ca2b0 0x7f05080c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050815ce50 con 0x7f050806e410 2023-10-14T11:23:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050815d0a0 con 0x7f05080ca2b0 2023-10-14T11:23:04.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050d1bd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050815d380 con 0x7f050806a810 2023-10-14T11:23:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 0x7f0508146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806e410 0x7f05080c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 0x7f0508146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43624/0 (socket says 172.21.15.67:43624) 2023-10-14T11:23:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 -- 172.21.15.67:0/3248262943 learned_addr learned my addr 172.21.15.67:0/3248262943 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f050759e700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080ca2b0 0x7f05080c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 -- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 msgr2=0x7fec1c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 0x7fec1c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 -- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1c1597a0 msgr2=0x7fec1c0c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec1c1597a0 0x7fec1c0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 -- 172.21.15.67:0/1960297331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1000fd90 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec1a59c700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fec1c072520 0x7fec1c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:04.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 -- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080ca2b0 msgr2=0x7f05080c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05080ca2b0 0x7f05080c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 -- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806e410 msgr2=0x7f05080c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f050806e410 0x7f05080c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f0506d9d700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500009b30 con 0x7f050806a810 2023-10-14T11:23:04.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fec19d9b700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c0cc9a0 0x7fec1c0c8c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec1400bdf0 tx=0x7fec14009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f5eff655700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f5ef80cf520 0x7f5ef8160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 --> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ef80ce270 con 0x7f5ef80cf520 2023-10-14T11:23:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f5efd3f1700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5edc06aed0 0x7f5edc06d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009710 tx=0x7f5eec006c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f0506d9d700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 0x7f0508146be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f050806dca0 tx=0x7f0500004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1400cc90 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0c47b0 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f5efcbf0700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f5ef80cf520 0x7f5ef8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0b41a0 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec14009890 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1401e440 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7fc3461df700 1 -- 172.21.15.67:0/2232948946 wait complete. 2023-10-14T11:23:04.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500004440 con 0x7f050806a810 2023-10-14T11:23:04.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f5efcbf0700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f5ef80cf520 0x7f5ef8160700 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7fc3461df700 1 Processor -- start 2023-10-14T11:23:04.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05000045a0 con 0x7f050806a810 2023-10-14T11:23:04.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500004930 con 0x7f050806a810 2023-10-14T11:23:04.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050815d660 con 0x7f050806a810 2023-10-14T11:23:04.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508156680 con 0x7f050806a810 2023-10-14T11:23:04.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7fc3461df700 1 -- start start 2023-10-14T11:23:04.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7f2aadd99700 1 Processor -- start 2023-10-14T11:23:04.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f728c9a7700 1 Processor -- start 2023-10-14T11:23:04.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.554+0000 7f728c9a7700 1 -- start start 2023-10-14T11:23:04.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 0x7f72880ca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f72880724a0 0x7f72880cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f728806ae60 0x7f728808a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728816e380 con 0x7f72880724a0 2023-10-14T11:23:04.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72880cd4d0 con 0x7f728806ae60 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728c9a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880cedc0 con 0x7f728806aa80 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 0x7f72880ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 0x7f72880ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43630/0 (socket says 172.21.15.67:43630) 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.555+0000 7f728659c700 1 -- 172.21.15.67:0/1831323269 learned_addr learned my addr 172.21.15.67:0/1831323269 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.556+0000 7f7285d9b700 1 --2- 172.21.15.67:0/1831323269 >> v2:172.21.15.67:3300/0 conn(0x7f72880724a0 0x7f72880cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7f7286d9d700 1 --2- 172.21.15.67:0/1831323269 >> v2:172.21.15.72:3300/0 conn(0x7f728806ae60 0x7f728808a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f7285d9b700 1 -- 172.21.15.67:0/1831323269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 msgr2=0x7f72880ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f7285d9b700 1 --2- 172.21.15.67:0/1831323269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 0x7f72880ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f7285d9b700 1 -- 172.21.15.67:0/1831323269 >> v2:172.21.15.72:3300/0 conn(0x7f728806ae60 msgr2=0x7f728808a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f7285d9b700 1 --2- 172.21.15.67:0/1831323269 >> v2:172.21.15.72:3300/0 conn(0x7f728806ae60 0x7f728808a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f7285d9b700 1 -- 172.21.15.67:0/1831323269 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880cf0a0 con 0x7f72880724a0 2023-10-14T11:23:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f7285d9b700 1 --2- 172.21.15.67:0/1831323269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72880724a0 0x7f72880cdee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f728816f610 tx=0x7f727800df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fb55ffd9aba0c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0500026450 con 0x7f050806a810 2023-10-14T11:23:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f04ef7fe700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f04f406afd0 0x7f04f406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f050008b0e0 con 0x7f050806a810 2023-10-14T11:23:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f04e8000fc0 con 0x7f050806a810 2023-10-14T11:23:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f050659c700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f04f406afd0 0x7f04f406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7f2aadd99700 1 -- start start 2023-10-14T11:23:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 0x7f2aa815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aa806a810 0x7f2aa806ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 0x7f2aa80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa80cf000 con 0x7f2aa80c2b20 2023-10-14T11:23:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa80ca8e0 con 0x7f2aa806a810 2023-10-14T11:23:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7f2aadd99700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa806b1b0 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aa806a810 0x7f2aa806ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2aa806a810 0x7f2aa806ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41774/0 (socket says 172.21.15.67:41774) 2023-10-14T11:23:04.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 -- 172.21.15.67:0/4115896450 learned_addr learned my addr 172.21.15.67:0/4115896450 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== osd.5 v2:172.21.15.72:6824/144247410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5ef4009980 con 0x7f5ef80cf520 2023-10-14T11:23:04.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fec1401e5a0 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fec0affd700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7febfc06af00 0x7febfc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec14089390 con 0x7fec1c0cc9a0 2023-10-14T11:23:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fec1a59c700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7febfc06af00 0x7febfc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fec20921700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7fec000015e0 0x7fec00003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 --> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec00006bd0 con 0x7fec000015e0 2023-10-14T11:23:04.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7fec1ad9d700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7fec000015e0 0x7fec00003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa77fe700 1 --2- 172.21.15.67:0/4115896450 >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 0x7f2aa815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f04ef7fe700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f04f4073170 0x7f04f4075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f04f4075c40 con 0x7f04f4073170 2023-10-14T11:23:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 -- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 msgr2=0x7f2aa80ca3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 0x7f2aa80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7fec1a59c700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7febfc06af00 0x7febfc06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec1c072190 tx=0x7fec10019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 0x7f2aa80ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 -- 172.21.15.67:0/4115896450 >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 msgr2=0x7f2aa815dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 --2- 172.21.15.67:0/4115896450 >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 0x7f2aa815dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa6ffd700 1 -- 172.21.15.67:0/4115896450 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa815e610 con 0x7f2aa806a810 2023-10-14T11:23:04.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa77fe700 1 --2- 172.21.15.67:0/4115896450 >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 0x7f2aa815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:04.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 0x7f2aa80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:04.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7fec1ad9d700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7fec000015e0 0x7fec00003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f050759e700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f04f4073170 0x7f04f4075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f728559a700 1 -- 172.21.15.67:0/1831323269 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727800b070 con 0x7f72880724a0 2023-10-14T11:23:04.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f728559a700 1 -- 172.21.15.67:0/1831323269 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278008a30 con 0x7f72880724a0 2023-10-14T11:23:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.559+0000 7f728559a700 1 -- 172.21.15.67:0/1831323269 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278008da0 con 0x7f72880724a0 2023-10-14T11:23:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.557+0000 7fc3461df700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 0x7fc3400c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fc3461df700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400c36c0 0x7fc3401ff640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fc3461df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3400c3ba0 0x7fc3400c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fc3461df700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3401ffb80 con 0x7fc3400c36c0 2023-10-14T11:23:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fc3461df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400c4560 con 0x7fc3400c3ba0 2023-10-14T11:23:04.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.558+0000 7fc3461df700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400b4c70 con 0x7fc328003a00 2023-10-14T11:23:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f2aa6ffd700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa806ac70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80c2f00 tx=0x7f2a9c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6dd5d2682ab5f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 0x7fc3400c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 0x7fc3400c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43650/0 (socket says 172.21.15.67:43650) 2023-10-14T11:23:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2596125927 learned_addr learned my addr 172.21.15.67:0/2596125927 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0500009360 con 0x7f050806a810 2023-10-14T11:23:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f2aa67fc700 1 -- 172.21.15.67:0/4115896450 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00b870 con 0x7f2aa806a810 2023-10-14T11:23:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f2aa67fc700 1 -- 172.21.15.67:0/4115896450 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c00b9d0 con 0x7f2aa806a810 2023-10-14T11:23:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f2aa67fc700 1 -- 172.21.15.67:0/4115896450 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00bd60 con 0x7f2aa806a810 2023-10-14T11:23:04.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f050759e700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f04f4073170 0x7f04f4075590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3400c3ba0 msgr2=0x7fc3400c4020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:23:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3400c3ba0 0x7fc3400c4020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400c36c0 msgr2=0x7fc3401ff640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:23:04.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3400c36c0 0x7fc3401ff640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fc33f7fe700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400b4060 con 0x7fc328003a00 2023-10-14T11:23:04.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f728c9a7700 1 -- 172.21.15.67:0/1831323269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72880724a0 msgr2=0x7f72880cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7f728c9a7700 1 --2- 172.21.15.67:0/1831323269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72880724a0 0x7f72880cdee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f728816f610 tx=0x7f727800df40 comp rx=0 tx=0).stop 2023-10-14T11:23:04.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f728c9a7700 1 -- 172.21.15.67:0/1831323269 shutdown_connections 2023-10-14T11:23:04.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f728c9a7700 1 --2- 172.21.15.67:0/1831323269 >> v2:172.21.15.72:3300/0 conn(0x7f728806ae60 0x7f728808a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f728c9a7700 1 --2- 172.21.15.67:0/1831323269 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f728806aa80 0x7f72880ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f728c9a7700 1 --2- 172.21.15.67:0/1831323269 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f72880724a0 0x7f72880cdee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f728c9a7700 1 -- 172.21.15.67:0/1831323269 >> 172.21.15.67:0/1831323269 conn(0x7f72880cbeb0 msgr2=0x7f72880cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 -- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 msgr2=0x7f2aa806ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa806ac70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80c2f00 tx=0x7f2a9c009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fd237fcc700 1 Processor -- start 2023-10-14T11:23:04.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.560+0000 7fd237fcc700 1 -- start start 2023-10-14T11:23:04.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 -- 172.21.15.67:0/4115896450 shutdown_connections 2023-10-14T11:23:04.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c9ef0 0x7f2aa80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 --2- 172.21.15.67:0/4115896450 >> v2:172.21.15.67:3300/0 conn(0x7f2aa80c2b20 0x7f2aa815dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 --2- 172.21.15.67:0/4115896450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa806ac70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 -- 172.21.15.67:0/4115896450 >> 172.21.15.67:0/4115896450 conn(0x7f2aa80b0f60 msgr2=0x7f2aa80b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== osd.2 v2:172.21.15.67:6822/192790195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f04f4075c40 con 0x7f04f4073170 2023-10-14T11:23:04.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== osd.7 v2:172.21.15.72:6808/4108692876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fec00006bd0 con 0x7fec000015e0 2023-10-14T11:23:04.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 -- 172.21.15.67:0/4115896450 shutdown_connections 2023-10-14T11:23:04.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.561+0000 7f2aadd99700 1 -- 172.21.15.67:0/4115896450 wait complete. 2023-10-14T11:23:04.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd237fcc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd230161d90 0x7fd23006b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd237fcc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2300cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd237fcc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23006b760 con 0x7fd2300c28a0 2023-10-14T11:23:04.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd237fcc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd230166660 con 0x7fd230161d90 2023-10-14T11:23:04.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd237fcc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300c2690 con 0x7fd2300ca190 2023-10-14T11:23:04.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2300cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd235567700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2300c28a0 0x7fd2300c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47496/0 (socket says 172.21.15.67:47496) 2023-10-14T11:23:04.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd235567700 1 -- 172.21.15.67:0/1573959666 learned_addr learned my addr 172.21.15.67:0/1573959666 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd235d68700 1 --2- 172.21.15.67:0/1573959666 >> v2:172.21.15.72:3300/0 conn(0x7fd230161d90 0x7fd23006b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd234d66700 1 -- 172.21.15.67:0/1573959666 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502586237 0 0) 0x7fd23006b760 con 0x7fd2300c28a0 2023-10-14T11:23:04.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 -- 172.21.15.67:0/1573959666 >> v2:172.21.15.72:3300/0 conn(0x7fd230161d90 msgr2=0x7fd23006b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 --2- 172.21.15.67:0/1573959666 >> v2:172.21.15.72:3300/0 conn(0x7fd230161d90 0x7fd23006b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 -- 172.21.15.67:0/1573959666 >> v1:172.21.15.72:6789/0 conn(0x7fd2300c28a0 legacy=0x7fd2300c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 -- 172.21.15.67:0/1573959666 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2301659e0 con 0x7fd2300ca190 2023-10-14T11:23:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.562+0000 7fd236569700 1 --2- 172.21.15.67:0/1573959666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2300cd4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009840 tx=0x7fd22c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35dda8707f44fc92 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.563+0000 7fd234d66700 1 -- 172.21.15.67:0/1573959666 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011830 con 0x7fd2300ca190 2023-10-14T11:23:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.563+0000 7fd234d66700 1 -- 172.21.15.67:0/1573959666 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c011990 con 0x7fd2300ca190 2023-10-14T11:23:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.563+0000 7fd234d66700 1 -- 172.21.15.67:0/1573959666 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011d20 con 0x7fd2300ca190 2023-10-14T11:23:04.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.563+0000 7f2aadd99700 1 Processor -- start 2023-10-14T11:23:04.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7f050659c700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f04f406afd0 0x7f04f406d490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f050806ede0 tx=0x7f04f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 -- 172.21.15.67:0/1573959666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 msgr2=0x7fd2300cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 --2- 172.21.15.67:0/1573959666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2300cd4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd22c009840 tx=0x7fd22c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 -- 172.21.15.67:0/1573959666 shutdown_connections 2023-10-14T11:23:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 --2- 172.21.15.67:0/1573959666 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2300cd4d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 --2- 172.21.15.67:0/1573959666 >> v2:172.21.15.72:3300/0 conn(0x7fd230161d90 0x7fd23006b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 -- 172.21.15.67:0/1573959666 >> 172.21.15.67:0/1573959666 conn(0x7fd2300cbeb0 msgr2=0x7fd2300cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 -- 172.21.15.67:0/1573959666 shutdown_connections 2023-10-14T11:23:04.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7fd237fcc700 1 -- 172.21.15.67:0/1573959666 wait complete. 2023-10-14T11:23:04.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.564+0000 7f2aadd99700 1 -- start start 2023-10-14T11:23:04.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa80b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c2b20 0x7f2aa80c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aa80c9ef0 0x7f2aa8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa80c6040 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa80c38f0 con 0x7f2aa806a810 2023-10-14T11:23:04.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aadd99700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa80b4080 con 0x7f2aa80c2b20 2023-10-14T11:23:04.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa80b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aa77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa80b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41794/0 (socket says 172.21.15.67:41794) 2023-10-14T11:23:04.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aa77fe700 1 -- 172.21.15.67:0/335822646 learned_addr learned my addr 172.21.15.67:0/335822646 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.565+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aa80c9ef0 0x7f2aa8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f728c9a7700 1 -- 172.21.15.67:0/1831323269 shutdown_connections 2023-10-14T11:23:04.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 -- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c2b20 msgr2=0x7f2aa80c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2aa80c2b20 0x7f2aa80c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 -- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 msgr2=0x7f2aa80b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2aa806a810 0x7f2aa80b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c009550 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7fd237fcc700 1 Processor -- start 2023-10-14T11:23:04.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f2aa7fff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aa80c9ef0 0x7f2aa8156530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000cc90 tx=0x7f2aa000a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7fd237fcc700 1 -- start start 2023-10-14T11:23:04.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.567+0000 7fd237fcc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300c28a0 0x7fd2300c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.567+0000 7fd237fcc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2301f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.567+0000 7fd237fcc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd230161d90 0x7fd2301fac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd237fcc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23015b440 con 0x7fd230161d90 2023-10-14T11:23:04.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd237fcc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300af220 con 0x7fd2300c28a0 2023-10-14T11:23:04.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd237fcc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300affa0 con 0x7fd2300ca190 2023-10-14T11:23:04.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235d68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300c28a0 0x7fd2300c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235d68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300c28a0 0x7fd2300c6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41800/0 (socket says 172.21.15.67:41800) 2023-10-14T11:23:04.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235d68700 1 -- 172.21.15.67:0/2134305970 learned_addr learned my addr 172.21.15.67:0/2134305970 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2301f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd236569700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd230161d90 0x7fd2301fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.566+0000 7f728c9a7700 1 -- 172.21.15.67:0/1831323269 wait complete. 2023-10-14T11:23:04.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7f728c9a7700 1 Processor -- start 2023-10-14T11:23:04.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 -- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300c28a0 msgr2=0x7fd2300c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2300c28a0 0x7fd2300c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 -- 172.21.15.67:0/2134305970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd230161d90 msgr2=0x7fd2301fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd230161d90 0x7fd2301fac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0094a0 con 0x7fd2300ca190 2023-10-14T11:23:04.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7fd235567700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2301f7100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd22800cc00 tx=0x7fd22800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22800ab30 con 0x7fd2300ca190 2023-10-14T11:23:04.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22800ac90 con 0x7fd2300ca190 2023-10-14T11:23:04.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280070d0 con 0x7fd2300ca190 2023-10-14T11:23:04.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.568+0000 7f728c9a7700 1 -- start start 2023-10-14T11:23:04.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 0x7f72880898e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f728806ae60 0x7f72880c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72880724a0 0x7f72880c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c37b0 con 0x7f728806aa80 2023-10-14T11:23:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c3a90 con 0x7f728806ae60 2023-10-14T11:23:04.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7f728c9a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880c3d70 con 0x7f72880724a0 2023-10-14T11:23:04.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000ada0 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa000f480 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000f830 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa80c4130 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa8154df0 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2300b4e20 con 0x7fd2300ca190 2023-10-14T11:23:04.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.569+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300af4c0 con 0x7fd2300ca190 2023-10-14T11:23:04.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f7285d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f728806ae60 0x7f72880c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f728659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 0x7f72880898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f7285d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f728806ae60 0x7f72880c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41810/0 (socket says 172.21.15.67:41810) 2023-10-14T11:23:04.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f7285d9b700 1 -- 172.21.15.67:0/2442831363 learned_addr learned my addr 172.21.15.67:0/2442831363 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f728659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 0x7f72880898e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41398/0 (socket says 172.21.15.67:41398) 2023-10-14T11:23:04.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.570+0000 7f7286d9d700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72880724a0 0x7f72880c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 -- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72880724a0 msgr2=0x7f72880c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f72880724a0 0x7f72880c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 -- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f728806ae60 msgr2=0x7f72880c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f728806ae60 0x7f72880c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727800d940 con 0x7f728806aa80 2023-10-14T11:23:04.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd230165fa0 con 0x7fd2300ca190 2023-10-14T11:23:04.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f728659c700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 0x7f72880898e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7280008980 tx=0x7f7280008c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd228007230 con 0x7fd2300ca190 2023-10-14T11:23:04.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.571+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2aa815ebd0 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc33f7fe700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 0x7fc3400c5af0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c1a0 tx=0x7fc334001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd2267fc700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd21406af00 0x7fd21406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334001630 con 0x7fc328003a00 2023-10-14T11:23:04.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3400b4340 con 0x7fc328003a00 2023-10-14T11:23:04.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334005900 con 0x7fc328003a00 2023-10-14T11:23:04.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33401d620 con 0x7fc328003a00 2023-10-14T11:23:04.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3400b4900 con 0x7fc328003a00 2023-10-14T11:23:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd228089100 con 0x7fd2300ca190 2023-10-14T11:23:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd235d68700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd21406af00 0x7fd21406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd2267fc700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7fd2140730a0 0x7fd2140754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd214075b70 con 0x7fd2140730a0 2023-10-14T11:23:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd22808b7c0 con 0x7fd2300ca190 2023-10-14T11:23:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.572+0000 7fd236569700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7fd2140730a0 0x7fd2140754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.573+0000 7fd236569700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7fd2140730a0 0x7fd2140754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.573+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc320000fc0 con 0x7fc328003a00 2023-10-14T11:23:04.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.573+0000 7fd235d68700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd21406af00 0x7fd21406d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b3e70 tx=0x7fd220008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.573+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== osd.6 v2:172.21.15.72:6812/1411932619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd214075b70 con 0x7fd2140730a0 2023-10-14T11:23:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.575+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2aa000b040 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.575+0000 7f2a8ffff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2a9406af50 0x7f2a9406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa008a010 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2aa77fe700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2a9406af50 0x7f2a9406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2a8ffff700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2a94073170 0x7f2a94075590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a94075c40 con 0x7f2a94073170 2023-10-14T11:23:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aa008a4b0 con 0x7f2aa80c9ef0 2023-10-14T11:23:04.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2aa6ffd700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2a94073170 0x7f2a94075590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.576+0000 7f2aa6ffd700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2a94073170 0x7f2a94075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.577+0000 7f2aa77fe700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2a9406af50 0x7f2a9406d410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8154a80 tx=0x7f2a98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.577+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== osd.3 v2:172.21.15.67:6800/1563372793 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2a94075c40 con 0x7f2a94073170 2023-10-14T11:23:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.579+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc33401d780 con 0x7fc328003a00 2023-10-14T11:23:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.579+0000 7fc327fff700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc32c06af00 0x7fc32c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.579+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc33408aa60 con 0x7fc328003a00 2023-10-14T11:23:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.580+0000 7fc327fff700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7fc32c0730a0 0x7fc32c0754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.580+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc32c075b70 con 0x7fc32c0730a0 2023-10-14T11:23:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.580+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc33408f2a0 con 0x7fc328003a00 2023-10-14T11:23:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.580+0000 7fc33ffff700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7fc32c0730a0 0x7fc32c0754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.580+0000 7fc33ffff700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7fc32c0730a0 0x7fc32c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.581+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== osd.0 v2:172.21.15.67:6808/1521584276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc32c075b70 con 0x7fc32c0730a0 2023-10-14T11:23:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.586+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 --> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f04e8002d40 con 0x7f04f4073170 2023-10-14T11:23:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.586+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000eab0 con 0x7f728806aa80 2023-10-14T11:23:04.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.586+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280013070 con 0x7f728806aa80 2023-10-14T11:23:04.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.586+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728000ee30 con 0x7f728806aa80 2023-10-14T11:23:04.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.587+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880c4050 con 0x7f728806aa80 2023-10-14T11:23:04.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.587+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72880c4850 con 0x7f728806aa80 2023-10-14T11:23:04.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.587+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72880cd9c0 con 0x7f728806aa80 2023-10-14T11:23:04.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.588+0000 7fdb71960700 1 Processor -- start 2023-10-14T11:23:04.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.588+0000 7fdb71960700 1 -- start start 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb71960700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb6c159830 0x7fdb6c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb71960700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb6c06af20 0x7fdb6c070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb71960700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c15d590 con 0x7fdb6c159c10 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb71960700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c15d870 con 0x7fdb6c159830 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb71960700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c15db50 con 0x7fdb6c06af20 2023-10-14T11:23:04.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.589+0000 7fdb6affd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb6c159830 0x7fdb6c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb6c159830 0x7fdb6c0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41414/0 (socket says 172.21.15.67:41414) 2023-10-14T11:23:04.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 -- 172.21.15.67:0/3342838334 learned_addr learned my addr 172.21.15.67:0/3342838334 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 -- 172.21.15.67:0/3342838334 >> v2:172.21.15.72:3300/0 conn(0x7fdb6c06af20 msgr2=0x7fdb6c070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 --2- 172.21.15.67:0/3342838334 >> v2:172.21.15.72:3300/0 conn(0x7fdb6c06af20 0x7fdb6c070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 -- 172.21.15.67:0/3342838334 >> v1:172.21.15.72:6789/0 conn(0x7fdb6c159c10 legacy=0x7fdb6c06a810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 -- 172.21.15.67:0/3342838334 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c15de30 con 0x7fdb6c159830 2023-10-14T11:23:04.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb6affd700 1 --2- 172.21.15.67:0/3342838334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159830 0x7fdb6c0c9a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c15d4d0 tx=0x7fdb5c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b1841685f3224 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3342838334 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c010070 con 0x7fdb6c159830 2023-10-14T11:23:04.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3342838334 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00da40 con 0x7fdb6c159830 2023-10-14T11:23:04.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7fdb69ffb700 1 -- 172.21.15.67:0/3342838334 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00ddd0 con 0x7fdb6c159830 2023-10-14T11:23:04.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f728000f430 con 0x7f728806aa80 2023-10-14T11:23:04.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.590+0000 7f7276ffd700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f726806afd0 0x7f726806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f728008a310 con 0x7f728806aa80 2023-10-14T11:23:04.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7276ffd700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f72680731f0 0x7f7268075610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7268075cc0 con 0x7f72680731f0 2023-10-14T11:23:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f728008a6c0 con 0x7f728806aa80 2023-10-14T11:23:04.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7fc33effd700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc32c06af00 0x7fc32c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7285d9b700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f726806afd0 0x7f726806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f04ef7fe700 1 -- 172.21.15.67:0/3248262943 <== osd.2 v2:172.21.15.67:6822/192790195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f04e8002d40 con 0x7f04f4073170 2023-10-14T11:23:04.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7f7286d9d700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f72680731f0 0x7f7268075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7fdb71960700 1 -- 172.21.15.67:0/3342838334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159830 msgr2=0x7fdb6c0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.591+0000 7fdb71960700 1 --2- 172.21.15.67:0/3342838334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159830 0x7fdb6c0c9a80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c15d4d0 tx=0x7fdb5c00d330 comp rx=0 tx=0).stop 2023-10-14T11:23:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7fdb71960700 1 -- 172.21.15.67:0/3342838334 shutdown_connections 2023-10-14T11:23:04.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7fdb71960700 1 --2- 172.21.15.67:0/3342838334 >> v2:172.21.15.72:3300/0 conn(0x7fdb6c06af20 0x7fdb6c070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7fdb71960700 1 --2- 172.21.15.67:0/3342838334 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159830 0x7fdb6c0c9a80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7fdb71960700 1 -- 172.21.15.67:0/3342838334 >> 172.21.15.67:0/3342838334 conn(0x7fdb6c0cbeb0 msgr2=0x7fdb6c0cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7f7286d9d700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f72680731f0 0x7f7268075610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7fc33effd700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc32c06af00 0x7fc32c06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c6320 tx=0x7fc338009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.592+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 --> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ef804ebb0 con 0x7f5ef80cf520 2023-10-14T11:23:04.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f7285d9b700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f726806afd0 0x7f726806d490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72880c59d0 tx=0x7f7278010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f04f4073170 msgr2=0x7f04f4075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f04f4073170 0x7f04f4075590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f04f406afd0 msgr2=0x7f04f406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f04f406afd0 0x7f04f406d490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f050806ede0 tx=0x7f04f8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:04.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 msgr2=0x7f0508146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 --2- 172.21.15.67:0/3248262943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f050806a810 0x7f0508146be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f050806dca0 tx=0x7f0500004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050759e700 1 -- 172.21.15.67:0/3248262943 reap_dead start 2023-10-14T11:23:04.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 shutdown_connections 2023-10-14T11:23:04.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 >> 172.21.15.67:0/3248262943 conn(0x7f05080cbeb0 msgr2=0x7f05080cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 shutdown_connections 2023-10-14T11:23:04.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7f050d1bd700 1 -- 172.21.15.67:0/3248262943 wait complete. 2023-10-14T11:23:04.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7fdb71960700 1 -- 172.21.15.67:0/3342838334 shutdown_connections 2023-10-14T11:23:04.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.593+0000 7fdb71960700 1 -- 172.21.15.67:0/3342838334 wait complete. 2023-10-14T11:23:04.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.596+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== osd.1 v2:172.21.15.67:6816/1515378619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7268075cc0 con 0x7f72680731f0 2023-10-14T11:23:04.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.596+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 --> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec00005cb0 con 0x7fec000015e0 2023-10-14T11:23:04.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.596+0000 7f5ee9ffb700 1 -- 172.21.15.67:0/2173248694 <== osd.5 v2:172.21.15.72:6824/144247410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ef804ebb0 con 0x7f5ef80cf520 2023-10-14T11:23:04.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.595+0000 7fdb71960700 1 Processor -- start 2023-10-14T11:23:04.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.596+0000 7fdb71960700 1 -- start start 2023-10-14T11:23:04.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 0x7fdb6c1fbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6c159830 0x7fdb6c0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159c10 0x7fdb6c155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0c89c0 con 0x7fdb6c159c10 2023-10-14T11:23:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c155e50 con 0x7fdb6c159830 2023-10-14T11:23:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fdb71960700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c156930 con 0x7fdb6c06af20 2023-10-14T11:23:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 0x7fdb6c1fbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 0x7fdb6c1fbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43698/0 (socket says 172.21.15.67:43698) 2023-10-14T11:23:04.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 -- 172.21.15.67:0/2402477672 learned_addr learned my addr 172.21.15.67:0/2402477672 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6b7fe700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159c10 0x7fdb6c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 -- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6c159830 msgr2=0x7fdb6c0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb6c159830 0x7fdb6c0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 -- 172.21.15.67:0/2402477672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159c10 msgr2=0x7fdb6c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb6c159c10 0x7fdb6c155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0085d0 con 0x7fdb6c06af20 2023-10-14T11:23:04.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb6affd700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 0x7fdb6c1fbcc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c019040 tx=0x7fdb5c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.598+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c008d60 con 0x7fdb6c06af20 2023-10-14T11:23:04.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c003820 con 0x7fdb6c06af20 2023-10-14T11:23:04.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c003bd0 con 0x7fdb6c06af20 2023-10-14T11:23:04.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 --> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd230165cc0 con 0x7fd2140730a0 2023-10-14T11:23:04.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fd2267fc700 1 -- 172.21.15.67:0/2134305970 <== osd.6 v2:172.21.15.72:6812/1411932619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd22c022040 con 0x7fd2140730a0 2023-10-14T11:23:04.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c156c10 con 0x7fdb6c06af20 2023-10-14T11:23:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.599+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c1571d0 con 0x7fdb6c06af20 2023-10-14T11:23:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.600+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb6c072c90 con 0x7fdb6c06af20 2023-10-14T11:23:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb5c003d30 con 0x7fdb6c06af20 2023-10-14T11:23:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb5806af00 0x7fdb5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb5c08a800 con 0x7fdb6c06af20 2023-10-14T11:23:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7fdb580730a0 0x7fdb580754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb58075b70 con 0x7fdb580730a0 2023-10-14T11:23:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.601+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb5c08ac20 con 0x7fdb6c06af20 2023-10-14T11:23:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.602+0000 7fdb6b7fe700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7fdb580730a0 0x7fdb580754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.602+0000 7fdb6b7fe700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7fdb580730a0 0x7fdb580754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.603+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== osd.4 v2:172.21.15.72:6800/3701848169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdb58075b70 con 0x7fdb580730a0 2023-10-14T11:23:04.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7fd2140730a0 msgr2=0x7fd2140754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7fd2140730a0 0x7fd2140754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd21406af00 msgr2=0x7fd21406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd21406af00 0x7fd21406d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b3e70 tx=0x7fd220008040 comp rx=0 tx=0).stop 2023-10-14T11:23:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 msgr2=0x7fd2301f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 --2- 172.21.15.67:0/2134305970 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd2300ca190 0x7fd2301f7100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd22800cc00 tx=0x7fd22800cf10 comp rx=0 tx=0).stop 2023-10-14T11:23:04.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd236569700 1 -- 172.21.15.67:0/2134305970 reap_dead start 2023-10-14T11:23:04.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 shutdown_connections 2023-10-14T11:23:04.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.604+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 >> 172.21.15.67:0/2134305970 conn(0x7fd2300cbeb0 msgr2=0x7fd23015e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.597+0000 7fec0affd700 1 -- 172.21.15.67:0/1960297331 <== osd.7 v2:172.21.15.72:6808/4108692876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec00005cb0 con 0x7fec000015e0 2023-10-14T11:23:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.609+0000 7fdb6a7fc700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb5806af00 0x7fdb5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.609+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 shutdown_connections 2023-10-14T11:23:04.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.609+0000 7fd237fcc700 1 -- 172.21.15.67:0/2134305970 wait complete. 2023-10-14T11:23:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.609+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f5ef80cf520 msgr2=0x7f5ef8160700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.609+0000 7f5eff655700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f5ef80cf520 0x7f5ef8160700 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.695 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2023-10-14T11:23:04.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T11:23:04.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fdb6a7fc700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb5806af00 0x7fdb5806d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0cfbf0 tx=0x7fdb60006c30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.611+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 --> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2aa815e930 con 0x7f2a94073170 2023-10-14T11:23:04.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.611+0000 7f2a8ffff700 1 -- 172.21.15.67:0/335822646 <== osd.3 v2:172.21.15.67:6800/1563372793 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a9c00b790 con 0x7f2a94073170 2023-10-14T11:23:04.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7fec000015e0 msgr2=0x7fec00003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7fec000015e0 0x7fec00003aa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7febfc06af00 msgr2=0x7febfc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7febfc06af00 0x7febfc06d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec1c072190 tx=0x7fec10019000 comp rx=0 tx=0).stop 2023-10-14T11:23:04.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c0cc9a0 msgr2=0x7fec1c0c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.610+0000 7fec20921700 1 --2- 172.21.15.67:0/1960297331 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fec1c0cc9a0 0x7fec1c0c8c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fec1400bdf0 tx=0x7fec14009f70 comp rx=0 tx=0).stop 2023-10-14T11:23:04.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5edc06aed0 msgr2=0x7f5edc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5edc06aed0 0x7f5edc06d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009710 tx=0x7f5eec006c60 comp rx=0 tx=0).stop 2023-10-14T11:23:04.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 msgr2=0x7f5ef80b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 --2- 172.21.15.67:0/2173248694 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ef815dde0 0x7f5ef80b08e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ef806f560 tx=0x7f5ef0004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5efdbf2700 1 -- 172.21.15.67:0/2173248694 reap_dead start 2023-10-14T11:23:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 shutdown_connections 2023-10-14T11:23:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 >> 172.21.15.67:0/2173248694 conn(0x7f5ef80cbeb0 msgr2=0x7f5ef80ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 shutdown_connections 2023-10-14T11:23:04.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f5eff655700 1 -- 172.21.15.67:0/2173248694 wait complete. 2023-10-14T11:23:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2a94073170 msgr2=0x7f2a94075590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2a94073170 0x7f2a94075590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2a9406af50 msgr2=0x7f2a9406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2a9406af50 0x7f2a9406d410 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8154a80 tx=0x7f2a98008040 comp rx=0 tx=0).stop 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aa80c9ef0 msgr2=0x7f2aa8156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 --2- 172.21.15.67:0/335822646 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2aa80c9ef0 0x7f2aa8156530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000cc90 tx=0x7f2aa000a280 comp rx=0 tx=0).stop 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aa7fff700 1 -- 172.21.15.67:0/335822646 reap_dead start 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 shutdown_connections 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 >> 172.21.15.67:0/335822646 conn(0x7f2aa80b0f60 msgr2=0x7f2aa8160870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.612+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 shutdown_connections 2023-10-14T11:23:04.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.613+0000 7f2aadd99700 1 -- 172.21.15.67:0/335822646 wait complete. 2023-10-14T11:23:04.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.614+0000 7fec1ad9d700 1 -- 172.21.15.67:0/1960297331 reap_dead start 2023-10-14T11:23:04.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.614+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 shutdown_connections 2023-10-14T11:23:04.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.614+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 >> 172.21.15.67:0/1960297331 conn(0x7fec1c0cbeb0 msgr2=0x7fec1c158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.616+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 --> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc320002d40 con 0x7fc32c0730a0 2023-10-14T11:23:04.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.616+0000 7fc327fff700 1 -- 172.21.15.67:0/2596125927 <== osd.0 v2:172.21.15.67:6808/1521584276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc320002d40 con 0x7fc32c0730a0 2023-10-14T11:23:04.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7fc32c0730a0 msgr2=0x7fc32c0754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7fc32c0730a0 0x7fc32c0754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc32c06af00 msgr2=0x7fc32c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc32c06af00 0x7fc32c06d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3400c6320 tx=0x7fc338009250 comp rx=0 tx=0).stop 2023-10-14T11:23:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 msgr2=0x7fc3400c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 --2- 172.21.15.67:0/2596125927 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc328003a00 0x7fc3400c5af0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c1a0 tx=0x7fc334001930 comp rx=0 tx=0).stop 2023-10-14T11:23:04.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc33ffff700 1 -- 172.21.15.67:0/2596125927 reap_dead start 2023-10-14T11:23:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 shutdown_connections 2023-10-14T11:23:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 >> 172.21.15.67:0/2596125927 conn(0x7fc3400cbeb0 msgr2=0x7fc34015e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 shutdown_connections 2023-10-14T11:23:04.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.617+0000 7fc3461df700 1 -- 172.21.15.67:0/2596125927 wait complete. 2023-10-14T11:23:04.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.618+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 shutdown_connections 2023-10-14T11:23:04.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.618+0000 7fec20921700 1 -- 172.21.15.67:0/1960297331 wait complete. 2023-10-14T11:23:04.710 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:04.710 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T11:23:04.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.629+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 --> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb6c15e110 con 0x7fdb580730a0 2023-10-14T11:23:04.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb53fff700 1 -- 172.21.15.67:0/2402477672 <== osd.4 v2:172.21.15.72:6800/3701848169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb64009bb0 con 0x7fdb580730a0 2023-10-14T11:23:04.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7fdb580730a0 msgr2=0x7fdb580754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7fdb580730a0 0x7fdb580754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb5806af00 msgr2=0x7fdb5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb5806af00 0x7fdb5806d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0cfbf0 tx=0x7fdb60006c30 comp rx=0 tx=0).stop 2023-10-14T11:23:04.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 msgr2=0x7fdb6c1fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 --2- 172.21.15.67:0/2402477672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb6c06af20 0x7fdb6c1fbcc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c019040 tx=0x7fdb5c004750 comp rx=0 tx=0).stop 2023-10-14T11:23:04.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb6b7fe700 1 -- 172.21.15.67:0/2402477672 reap_dead start 2023-10-14T11:23:04.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.630+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 shutdown_connections 2023-10-14T11:23:04.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.631+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 >> 172.21.15.67:0/2402477672 conn(0x7fdb6c0cbeb0 msgr2=0x7fdb6c1588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.631+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 shutdown_connections 2023-10-14T11:23:04.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.631+0000 7fdb71960700 1 -- 172.21.15.67:0/2402477672 wait complete. 2023-10-14T11:23:04.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.635+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 --> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f72880cd6e0 con 0x7f72680731f0 2023-10-14T11:23:04.715 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:04.716 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T11:23:04.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.635+0000 7f7276ffd700 1 -- 172.21.15.67:0/2442831363 <== osd.1 v2:172.21.15.67:6816/1515378619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f727c0112b0 con 0x7f72680731f0 2023-10-14T11:23:04.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f72680731f0 msgr2=0x7f7268075610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f72680731f0 0x7f7268075610 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f726806afd0 msgr2=0x7f726806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f726806afd0 0x7f726806d490 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72880c59d0 tx=0x7f7278010000 comp rx=0 tx=0).stop 2023-10-14T11:23:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 msgr2=0x7f72880898e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 --2- 172.21.15.67:0/2442831363 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f728806aa80 0x7f72880898e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7280008980 tx=0x7f7280008c90 comp rx=0 tx=0).stop 2023-10-14T11:23:04.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f7286d9d700 1 -- 172.21.15.67:0/2442831363 reap_dead start 2023-10-14T11:23:04.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 shutdown_connections 2023-10-14T11:23:04.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 >> 172.21.15.67:0/2442831363 conn(0x7f72880cbeb0 msgr2=0x7f72880cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 shutdown_connections 2023-10-14T11:23:04.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.636+0000 7f728c9a7700 1 -- 172.21.15.67:0/2442831363 wait complete. 2023-10-14T11:23:04.720 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2023-10-14T11:23:04.720 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T11:23:04.721 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:04.722 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T11:23:04.723 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:04.723 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T11:23:04.724 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:04.724 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T11:23:04.725 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:04.725 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T11:23:04.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.958+0000 7ff2c8a26700 1 Processor -- start 2023-10-14T11:23:04.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.958+0000 7ff2c8a26700 1 -- start start 2023-10-14T11:23:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.959+0000 7ff2c8a26700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff2c40ca190 0x7ff2c406b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.959+0000 7ff2c8a26700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c406b760 con 0x7ff2c4161d90 2023-10-14T11:23:04.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.959+0000 7ff2c8a26700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c40c2690 con 0x7ff2c40c28a0 2023-10-14T11:23:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.959+0000 7ff2c8a26700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c4166660 con 0x7ff2c40ca190 2023-10-14T11:23:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.960+0000 7ff2c259c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff2c4161d90 0x7ff2c40c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40730/0 (socket says 172.21.15.67:40730) 2023-10-14T11:23:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.960+0000 7ff2c259c700 1 -- 172.21.15.67:0/2130648152 learned_addr learned my addr 172.21.15.67:0/2130648152 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.960+0000 7ff2c1d9b700 1 --2- 172.21.15.67:0/2130648152 >> v2:172.21.15.72:3300/0 conn(0x7ff2c40ca190 0x7ff2c406b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.960+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992095815 0 0) 0x7ff2c406b760 con 0x7ff2c4161d90 2023-10-14T11:23:04.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.960+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2ac0035b0 con 0x7ff2c4161d90 2023-10-14T11:23:04.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442216744 0 0) 0x7ff2c40c2690 con 0x7ff2c40c28a0 2023-10-14T11:23:04.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c406b760 con 0x7ff2c40c28a0 2023-10-14T11:23:04.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 221159263 0 0) 0x7ff2ac0035b0 con 0x7ff2c4161d90 2023-10-14T11:23:04.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 >> v2:172.21.15.72:3300/0 conn(0x7ff2c40ca190 msgr2=0x7ff2c406b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 --2- 172.21.15.67:0/2130648152 >> v2:172.21.15.72:3300/0 conn(0x7ff2c40ca190 0x7ff2c406b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 >> v1:172.21.15.72:6789/0 conn(0x7ff2c40c28a0 legacy=0x7ff2c40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c41659e0 con 0x7ff2c4161d90 2023-10-14T11:23:04.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7ff2b8001670 con 0x7ff2c4161d90 2023-10-14T11:23:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 >> v1:172.21.15.67:6789/0 conn(0x7ff2c4161d90 legacy=0x7ff2c40c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac003be0 0x7ff2ac003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2ac004850 0x7ff2ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 0x7ff2ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4166660 con 0x7ff2ac005260 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac00c190 con 0x7ff2ac004850 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac00c350 con 0x7ff2ac003be0 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 0x7ff2ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac003be0 msgr2=0x7ff2ac003fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac003be0 0x7ff2ac003fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2ac004850 msgr2=0x7ff2ac004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2ac004850 0x7ff2ac004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.961+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/2130648152 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c41659e0 con 0x7ff2ac005260 2023-10-14T11:23:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.962+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/2130648152 reap_dead start 2023-10-14T11:23:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.962+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 0x7ff2ac00ba10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c210 tx=0x7ff2ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbfab2b840074de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.962+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00cdb0 con 0x7ff2ac005260 2023-10-14T11:23:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.962+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc003a00 con 0x7ff2ac005260 2023-10-14T11:23:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.962+0000 7ff2c159a700 1 -- 172.21.15.67:0/2130648152 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc003db0 con 0x7ff2ac005260 2023-10-14T11:23:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.963+0000 7ff2c8a26700 1 -- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 msgr2=0x7ff2ac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.963+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 0x7ff2ac00ba10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c210 tx=0x7ff2ac005880 comp rx=0 tx=0).stop 2023-10-14T11:23:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.964+0000 7ff2c8a26700 1 -- 172.21.15.67:0/2130648152 shutdown_connections 2023-10-14T11:23:04.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.964+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/2130648152 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2ac005260 0x7ff2ac00ba10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.964+0000 7ff2c8a26700 1 -- 172.21.15.67:0/2130648152 >> 172.21.15.67:0/2130648152 conn(0x7ff2c40cbeb0 msgr2=0x7ff2c40cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.966+0000 7ff2c8a26700 1 -- 172.21.15.67:0/2130648152 shutdown_connections 2023-10-14T11:23:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.966+0000 7ff2c8a26700 1 -- 172.21.15.67:0/2130648152 wait complete. 2023-10-14T11:23:04.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.968+0000 7ff2c8a26700 1 Processor -- start 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.968+0000 7ff2c8a26700 1 -- start start 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac005260 0x7ff2c40c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2c40c9290 0x7ff2c41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40b3c50 con 0x7ff2c40b4070 2023-10-14T11:23:04.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40c9750 con 0x7ff2c40c9290 2023-10-14T11:23:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7ff2c8a26700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40b32b0 con 0x7ff2ac005260 2023-10-14T11:23:04.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.969+0000 7fb12bc8d700 1 Processor -- start 2023-10-14T11:23:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41450/0 (socket says 172.21.15.67:41450) 2023-10-14T11:23:04.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/3956910846 learned_addr learned my addr 172.21.15.67:0/3956910846 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:04.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac005260 msgr2=0x7ff2c40c7360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:23:04.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac005260 0x7ff2c40c7360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2c40c9290 msgr2=0x7ff2c41539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2c40c9290 0x7ff2c41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7ff2c2d9d700 1 -- 172.21.15.67:0/3956910846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40b3590 con 0x7ff2c40b4070 2023-10-14T11:23:04.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.971+0000 7ff2c2d9d700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40c6490 tx=0x7ff2bc001580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.970+0000 7fb12bc8d700 1 -- start start 2023-10-14T11:23:04.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.971+0000 7fb12bc8d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb124159c10 0x7fb1240c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.971+0000 7fb129a29700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb124159830 0x7fb12406a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40746/0 (socket says 172.21.15.67:40746) 2023-10-14T11:23:04.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.971+0000 7fb129a29700 1 -- 172.21.15.67:0/662517728 learned_addr learned my addr 172.21.15.67:0/662517728 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb12a22a700 1 --2- 172.21.15.67:0/662517728 >> v2:172.21.15.72:3300/0 conn(0x7fb124159c10 0x7fb1240c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.971+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12415d590 con 0x7fb124159830 2023-10-14T11:23:04.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12415d870 con 0x7fb12406af20 2023-10-14T11:23:04.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12415db50 con 0x7fb124159c10 2023-10-14T11:23:04.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7f1bbfbec700 1 Processor -- start 2023-10-14T11:23:04.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987780164 0 0) 0x7fb12415d870 con 0x7fb12406af20 2023-10-14T11:23:04.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1100035b0 con 0x7fb12406af20 2023-10-14T11:23:04.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801629626 0 0) 0x7fb12415d590 con 0x7fb124159830 2023-10-14T11:23:04.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12415d870 con 0x7fb124159830 2023-10-14T11:23:04.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.1 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714259997 0 0) 0x7fb1100035b0 con 0x7fb12406af20 2023-10-14T11:23:04.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 >> v2:172.21.15.72:3300/0 conn(0x7fb124159c10 msgr2=0x7fb1240c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 --2- 172.21.15.67:0/662517728 >> v2:172.21.15.72:3300/0 conn(0x7fb124159c10 0x7fb1240c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 >> v1:172.21.15.67:6789/0 conn(0x7fb124159830 legacy=0x7fb12406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12415de30 con 0x7fb12406af20 2023-10-14T11:23:04.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.1 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7fb114001670 con 0x7fb12406af20 2023-10-14T11:23:04.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 >> v1:172.21.15.72:6789/0 conn(0x7fb12406af20 legacy=0x7fb124070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110003b90 0x7fb110003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb110004850 0x7fb110004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 0x7fb11000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12415db50 con 0x7fb110004850 2023-10-14T11:23:04.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11000c090 con 0x7fb110003b90 2023-10-14T11:23:04.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11000c250 con 0x7fb110005210 2023-10-14T11:23:04.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb129a29700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110003b90 0x7fb110003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb12a22a700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 0x7fb11000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7fb129228700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb110004850 0x7fb110004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7faea1216700 1 Processor -- start 2023-10-14T11:23:04.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.973+0000 7faea1216700 1 -- start start 2023-10-14T11:23:04.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 -- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110003b90 msgr2=0x7fb110003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110003b90 0x7fb110003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 -- 172.21.15.67:0/662517728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb110004850 msgr2=0x7fb110004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb110004850 0x7fb110004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:04.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 -- 172.21.15.67:0/662517728 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12415de30 con 0x7fb110005210 2023-10-14T11:23:04.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7fb12a22a700 1 -- 172.21.15.67:0/662517728 reap_dead start 2023-10-14T11:23:04.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.972+0000 7f1bbfbec700 1 -- start start 2023-10-14T11:23:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbfbec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1bb8159c10 0x7f1bb80c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbfbec700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb815d590 con 0x7f1bb806af20 2023-10-14T11:23:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbfbec700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb815d870 con 0x7f1bb8159830 2023-10-14T11:23:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbfbec700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb815db50 con 0x7f1bb8159c10 2023-10-14T11:23:04.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbd187700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1bb806af20 0x7f1bb8070da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40760/0 (socket says 172.21.15.67:40760) 2023-10-14T11:23:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbd187700 1 -- 172.21.15.67:0/3874413224 learned_addr learned my addr 172.21.15.67:0/3874413224 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbd988700 1 --1- 172.21.15.67:0/3874413224 >> v1:172.21.15.72:6789/0 conn(0x7f1bb8159830 0x7f1bb806a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47580/0 (socket says 172.21.15.67:47580) 2023-10-14T11:23:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbe189700 1 --2- 172.21.15.67:0/3874413224 >> v2:172.21.15.67:3300/0 conn(0x7f1bb8159c10 0x7f1bb80c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbc986700 1 -- 172.21.15.67:0/3874413224 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529858019 0 0) 0x7f1bb815d870 con 0x7f1bb8159830 2023-10-14T11:23:04.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbc986700 1 -- 172.21.15.67:0/3874413224 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba40035b0 con 0x7f1bb8159830 2023-10-14T11:23:04.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbe189700 1 -- 172.21.15.67:0/3874413224 >> v1:172.21.15.72:6789/0 conn(0x7f1bb8159830 legacy=0x7f1bb806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.974+0000 7f1bbe189700 1 -- 172.21.15.67:0/3874413224 >> v1:172.21.15.67:6789/0 conn(0x7f1bb806af20 legacy=0x7f1bb8070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7f1bbe189700 1 -- 172.21.15.67:0/3874413224 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb815de30 con 0x7f1bb8159c10 2023-10-14T11:23:04.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7f626d68d700 1 Processor -- start 2023-10-14T11:23:04.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7faea1216700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fae9c0720e0 0x7fae9c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7faea1216700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c071c50 con 0x7fae9c06a810 2023-10-14T11:23:04.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7faea1216700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c072540 con 0x7fae9c0ae660 2023-10-14T11:23:04.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7faea1216700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0aea40 con 0x7fae9c0720e0 2023-10-14T11:23:04.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7f1bbe189700 1 --2- 172.21.15.67:0/3874413224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb8159c10 0x7f1bb80c9a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009840 tx=0x7f1ba8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73e78c54ffaa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7fae9ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fae9c0ae660 0x7fae9c15e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47586/0 (socket says 172.21.15.67:47586) 2023-10-14T11:23:04.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7fae9ad9d700 1 -- 172.21.15.67:0/2067817792 learned_addr learned my addr 172.21.15.67:0/2067817792 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:04.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7fae9a59c700 1 --2- 172.21.15.67:0/2067817792 >> v2:172.21.15.72:3300/0 conn(0x7fae9c0720e0 0x7fae9c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7fb12a22a700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 0x7fb11000ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009fc0 tx=0x7fb110005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a9ce226f915be69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7fae99d9b700 1 -- 172.21.15.67:0/2067817792 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576337591 0 0) 0x7fae9c072540 con 0x7fae9c0ae660 2023-10-14T11:23:04.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c003c20 con 0x7fb110005210 2023-10-14T11:23:04.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00f040 con 0x7fb110005210 2023-10-14T11:23:04.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fb128a27700 1 -- 172.21.15.67:0/662517728 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00ea30 con 0x7fb110005210 2023-10-14T11:23:04.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fae9a59c700 1 -- 172.21.15.67:0/2067817792 >> v1:172.21.15.72:6789/0 conn(0x7fae9c0ae660 legacy=0x7fae9c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fae9a59c700 1 -- 172.21.15.67:0/2067817792 >> v1:172.21.15.67:6789/0 conn(0x7fae9c06a810 legacy=0x7fae9c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:04.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fae9a59c700 1 -- 172.21.15.67:0/2067817792 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0aec40 con 0x7fae9c0720e0 2023-10-14T11:23:04.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7fae9a59c700 1 --2- 172.21.15.67:0/2067817792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0720e0 0x7fae9c0cbeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009840 tx=0x7fae8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a8e4a3cfd478e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:04.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.975+0000 7f626d68d700 1 -- start start 2023-10-14T11:23:04.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f626d68d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:04.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f626d68d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268071650 con 0x7f6268162380 2023-10-14T11:23:04.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f626d68d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6268163040 con 0x7f62680c2d50 2023-10-14T11:23:04.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f626d68d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268163320 con 0x7f62680b1960 2023-10-14T11:23:04.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f1bbc986700 1 -- 172.21.15.67:0/3874413224 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800f8a0 con 0x7f1bb8159c10 2023-10-14T11:23:04.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f1bbc986700 1 -- 172.21.15.67:0/3874413224 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba800fa00 con 0x7f1bb8159c10 2023-10-14T11:23:04.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f1bbc986700 1 -- 172.21.15.67:0/3874413224 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800fd90 con 0x7f1bb8159c10 2023-10-14T11:23:04.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.976+0000 7f62667fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:04.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 msgr2=0x7fb11000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:04.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 0x7fb11000ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb11c009fc0 tx=0x7fb110005880 comp rx=0 tx=0).stop 2023-10-14T11:23:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43750/0 (socket says 172.21.15.67:43750) 2023-10-14T11:23:05.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 -- 172.21.15.67:0/3924526127 learned_addr learned my addr 172.21.15.67:0/3924526127 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0018e0 con 0x7ff2c40b4070 2023-10-14T11:23:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0052e0 con 0x7ff2c40b4070 2023-10-14T11:23:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c40b3870 con 0x7ff2c40b4070 2023-10-14T11:23:05.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c40c78a0 con 0x7ff2c40b4070 2023-10-14T11:23:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc005650 con 0x7ff2c40b4070 2023-10-14T11:23:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 shutdown_connections 2023-10-14T11:23:05.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/662517728 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb110005210 0x7fb11000ba10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 >> 172.21.15.67:0/662517728 conn(0x7fb1240cbeb0 msgr2=0x7fb1240cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 shutdown_connections 2023-10-14T11:23:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f1bbfbec700 1 -- 172.21.15.67:0/3874413224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb8159c10 msgr2=0x7f1bb80c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/3874413224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb8159c10 0x7f1bb80c9a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009840 tx=0x7f1ba8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:05.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 -- 172.21.15.67:0/3924526127 >> v1:172.21.15.72:6789/0 conn(0x7f62680c2d50 legacy=0x7f62680b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 -- 172.21.15.67:0/3924526127 >> v1:172.21.15.67:6789/0 conn(0x7f6268162380 legacy=0x7f62681627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 -- 172.21.15.67:0/3924526127 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268071000 con 0x7f62680b1960 2023-10-14T11:23:05.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7f62667fc700 1 --2- 172.21.15.67:0/3924526127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f625c009920 tx=0x7f625c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d356291e2e2b81 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fae99d9b700 1 -- 172.21.15.67:0/2067817792 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c004230 con 0x7fae9c0720e0 2023-10-14T11:23:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fae99d9b700 1 -- 172.21.15.67:0/2067817792 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c004390 con 0x7fae9c0720e0 2023-10-14T11:23:05.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.977+0000 7fae99d9b700 1 -- 172.21.15.67:0/2067817792 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0036a0 con 0x7fae9c0720e0 2023-10-14T11:23:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f6265ffb700 1 -- 172.21.15.67:0/3924526127 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c00ba60 con 0x7f62680b1960 2023-10-14T11:23:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f6265ffb700 1 -- 172.21.15.67:0/3924526127 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c00bbc0 con 0x7f62680b1960 2023-10-14T11:23:05.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f6265ffb700 1 -- 172.21.15.67:0/3924526127 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c009e70 con 0x7f62680b1960 2023-10-14T11:23:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f1bbfbec700 1 -- 172.21.15.67:0/3874413224 shutdown_connections 2023-10-14T11:23:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/3874413224 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb8159c10 0x7f1bb80c9a80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7f1bbfbec700 1 -- 172.21.15.67:0/3874413224 >> 172.21.15.67:0/3874413224 conn(0x7f1bb80cbeb0 msgr2=0x7f1bb80cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7faea1216700 1 -- 172.21.15.67:0/2067817792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0720e0 msgr2=0x7fae9c0cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7faea1216700 1 --2- 172.21.15.67:0/2067817792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0720e0 0x7fae9c0cbeb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fae8c009840 tx=0x7fae8c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f626d68d700 1 -- 172.21.15.67:0/3924526127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 msgr2=0x7f6268071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f626d68d700 1 --2- 172.21.15.67:0/3924526127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f625c009920 tx=0x7f625c009c30 comp rx=0 tx=0).stop 2023-10-14T11:23:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f1bbfbec700 1 -- 172.21.15.67:0/3874413224 shutdown_connections 2023-10-14T11:23:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7faea1216700 1 -- 172.21.15.67:0/2067817792 shutdown_connections 2023-10-14T11:23:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7faea1216700 1 --2- 172.21.15.67:0/2067817792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0720e0 0x7fae9c0cbeb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7faea1216700 1 -- 172.21.15.67:0/2067817792 >> 172.21.15.67:0/2067817792 conn(0x7fae9c0b0f60 msgr2=0x7fae9c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7faea1216700 1 -- 172.21.15.67:0/2067817792 shutdown_connections 2023-10-14T11:23:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f87484e7700 1 Processor -- start 2023-10-14T11:23:05.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7f87484e7700 1 -- start start 2023-10-14T11:23:05.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f87484e7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f874006af20 0x7f87400c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f87484e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8740159c10 0x7f8740070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f87484e7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874015d590 con 0x7f8740159830 2023-10-14T11:23:05.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f87484e7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874015d870 con 0x7f874006af20 2023-10-14T11:23:05.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f87484e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874015db50 con 0x7f8740159c10 2023-10-14T11:23:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a80052f0 con 0x7ff2c40b4070 2023-10-14T11:23:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff2bc0057b0 con 0x7ff2c40b4070 2023-10-14T11:23:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7ff2b2ffd700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 0x7ff2a406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2bc08a460 con 0x7ff2c40b4070 2023-10-14T11:23:05.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7ff2c259c700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 0x7ff2a406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.978+0000 7fb12bc8d700 1 -- 172.21.15.67:0/662517728 wait complete. 2023-10-14T11:23:05.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7fb12bc8d700 1 Processor -- start 2023-10-14T11:23:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f626d68d700 1 -- 172.21.15.67:0/3924526127 shutdown_connections 2023-10-14T11:23:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f626d68d700 1 --2- 172.21.15.67:0/3924526127 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680b1960 0x7f6268071ae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f626d68d700 1 -- 172.21.15.67:0/3924526127 >> 172.21.15.67:0/3924526127 conn(0x7f62680cc250 msgr2=0x7f62680cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7f626d68d700 1 -- 172.21.15.67:0/3924526127 shutdown_connections 2023-10-14T11:23:05.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7f626d68d700 1 -- 172.21.15.67:0/3924526127 wait complete. 2023-10-14T11:23:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f626d68d700 1 Processor -- start 2023-10-14T11:23:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.979+0000 7f1bbfbec700 1 -- 172.21.15.67:0/3874413224 wait complete. 2023-10-14T11:23:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7f1bbfbec700 1 Processor -- start 2023-10-14T11:23:05.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f1bbfbec700 1 -- start start 2023-10-14T11:23:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb806af20 0x7f1bb814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bb8159830 0x7f1bb80ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb814f5d0 con 0x7f1bb806af20 2023-10-14T11:23:05.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb8150800 con 0x7f1bb8159c10 2023-10-14T11:23:05.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbfbec700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb8150ae0 con 0x7f1bb8159830 2023-10-14T11:23:05.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f8a173ef700 1 Processor -- start 2023-10-14T11:23:05.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7faea1216700 1 -- 172.21.15.67:0/2067817792 wait complete. 2023-10-14T11:23:05.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f8745a82700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f874006af20 0x7f87400c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f8745a82700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f874006af20 0x7f87400c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41490/0 (socket says 172.21.15.67:41490) 2023-10-14T11:23:05.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f8745a82700 1 -- 172.21.15.67:0/1603126924 learned_addr learned my addr 172.21.15.67:0/1603126924 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8745a82700 1 -- 172.21.15.67:0/1603126924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8740159c10 msgr2=0x7f8740070da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8745a82700 1 --2- 172.21.15.67:0/1603126924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8740159c10 0x7f8740070da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8745a82700 1 -- 172.21.15.67:0/1603126924 >> v1:172.21.15.72:6789/0 conn(0x7f8740159830 legacy=0x7f874006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8745a82700 1 -- 172.21.15.67:0/1603126924 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874015de30 con 0x7f874006af20 2023-10-14T11:23:05.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8745a82700 1 --2- 172.21.15.67:0/1603126924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f874006af20 0x7f87400c9a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f87300088f0 tx=0x7f873000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3b161d0567f93d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7ff2c259c700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 0x7ff2a406d490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8001860 tx=0x7ff2b8001450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.980+0000 7fb12bc8d700 1 -- start start 2023-10-14T11:23:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12415a090 0x7fb12415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb12415a510 0x7fb12415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12415aae0 con 0x7fb12415a090 2023-10-14T11:23:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12415adc0 con 0x7fb110005210 2023-10-14T11:23:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.981+0000 7fb12bc8d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12415b0a0 con 0x7fb12415a510 2023-10-14T11:23:05.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7fb129a29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7fb129a29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41892/0 (socket says 172.21.15.67:41892) 2023-10-14T11:23:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7fb129a29700 1 -- 172.21.15.67:0/1175392491 learned_addr learned my addr 172.21.15.67:0/1175392491 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7fb12a22a700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb12415a510 0x7fb12415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f626d68d700 1 -- start start 2023-10-14T11:23:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680c2d50 0x7f62680cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6268162380 0x7f6268156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c4f10 con 0x7f6268162380 2023-10-14T11:23:05.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62680c4c00 con 0x7f62680b1960 2023-10-14T11:23:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f626d68d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6268157f80 con 0x7f62680c2d50 2023-10-14T11:23:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f6266ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f6266ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41904/0 (socket says 172.21.15.67:41904) 2023-10-14T11:23:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f6266ffd700 1 -- 172.21.15.67:0/3360759801 learned_addr learned my addr 172.21.15.67:0/3360759801 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.982+0000 7f8a173ef700 1 -- start start 2023-10-14T11:23:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8a173ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a1006a810 0x7f8a1006acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8a173ef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a10162270 con 0x7f8a100cdae0 2023-10-14T11:23:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8a173ef700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a10166540 con 0x7f8a10161e90 2023-10-14T11:23:05.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f8a173ef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100cd6c0 con 0x7f8a1006a810 2023-10-14T11:23:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f62667fc700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680c2d50 0x7f62680cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f62677fe700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6268162380 0x7f6268156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 -- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb12415a510 msgr2=0x7fb12415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb12415a510 0x7fb12415c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 -- 172.21.15.67:0/1175392491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12415a090 msgr2=0x7fb12415c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12415a090 0x7fb12415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 -- 172.21.15.67:0/1175392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12415b380 con 0x7fb110005210 2023-10-14T11:23:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbe189700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbe189700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41914/0 (socket says 172.21.15.67:41914) 2023-10-14T11:23:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.983+0000 7f1bbe189700 1 -- 172.21.15.67:0/1463548919 learned_addr learned my addr 172.21.15.67:0/1463548919 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbd187700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bb8159830 0x7f1bb80ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7faea1216700 1 Processor -- start 2023-10-14T11:23:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f8a1518b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8a10161e90 0x7f8a101659d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47624/0 (socket says 172.21.15.67:47624) 2023-10-14T11:23:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f8a1518b700 1 -- 172.21.15.67:0/1632157036 learned_addr learned my addr 172.21.15.67:0/1632157036 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:05.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb129a29700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb12000fce0 tx=0x7fb12000d600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 -- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bb8159830 msgr2=0x7f1bb80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bb8159830 0x7f1bb80ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 -- 172.21.15.67:0/1463548919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb806af20 msgr2=0x7f1bb814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb806af20 0x7f1bb814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 -- 172.21.15.67:0/1463548919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80094a0 con 0x7f1bb8159c10 2023-10-14T11:23:05.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f8a1498a700 1 --2- 172.21.15.67:0/1632157036 >> v2:172.21.15.72:3300/0 conn(0x7f8a1006a810 0x7f8a1006acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7faea1216700 1 -- start start 2023-10-14T11:23:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 -- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680c2d50 msgr2=0x7f62680cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680c2d50 0x7f62680cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 -- 172.21.15.67:0/3360759801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6268162380 msgr2=0x7f6268156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6268162380 0x7f6268156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 -- 172.21.15.67:0/3360759801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009550 con 0x7f62680b1960 2023-10-14T11:23:05.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000db90 con 0x7fb110005210 2023-10-14T11:23:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000dd10 con 0x7fb110005210 2023-10-14T11:23:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120018650 con 0x7fb110005210 2023-10-14T11:23:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f6266ffd700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f625800c4d0 tx=0x7f625800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12415b660 con 0x7fb110005210 2023-10-14T11:23:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1241f7960 con 0x7fb110005210 2023-10-14T11:23:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f8a1498a700 1 -- 172.21.15.67:0/1632157036 >> v1:172.21.15.72:6789/0 conn(0x7f8a10161e90 legacy=0x7f8a101659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:05.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f8a1498a700 1 -- 172.21.15.67:0/1632157036 >> v1:172.21.15.67:6789/0 conn(0x7f8a100cdae0 legacy=0x7f8a100cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f8a1498a700 1 -- 172.21.15.67:0/1632157036 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10166820 con 0x7f8a1006a810 2023-10-14T11:23:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f8a1498a700 1 --2- 172.21.15.67:0/1632157036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1006a810 0x7f8a1006acc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009840 tx=0x7f8a0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484c46426e01a77b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625800cea0 con 0x7f62680b1960 2023-10-14T11:23:05.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62580052d0 con 0x7f62680b1960 2023-10-14T11:23:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6258003680 con 0x7f62680b1960 2023-10-14T11:23:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae9c0720e0 0x7fae9c0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0ae660 0x7fae9c0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b4430 con 0x7fae9c06a810 2023-10-14T11:23:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0cdff0 con 0x7fae9c0ae660 2023-10-14T11:23:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7faea1216700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0ce2d0 con 0x7fae9c0720e0 2023-10-14T11:23:05.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.984+0000 7f1bbe189700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009b90 tx=0x7f1ba8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80038a0 con 0x7f1bb8159c10 2023-10-14T11:23:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8003a00 con 0x7f1bb8159c10 2023-10-14T11:23:05.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb8150dc0 con 0x7f1bb8159c10 2023-10-14T11:23:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.985+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb8151380 con 0x7f1bb8159c10 2023-10-14T11:23:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41514/0 (socket says 172.21.15.67:41514) 2023-10-14T11:23:05.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 -- 172.21.15.67:0/925888163 learned_addr learned my addr 172.21.15.67:0/925888163 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9a59c700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae9c0720e0 0x7fae9c0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9b59e700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0ae660 0x7fae9c0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 -- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae9c0720e0 msgr2=0x7fae9c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae9c0720e0 0x7fae9c0b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 -- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0ae660 msgr2=0x7fae9c0b3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0ae660 0x7fae9c0b3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 -- 172.21.15.67:0/925888163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0094a0 con 0x7fae9c06a810 2023-10-14T11:23:05.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fae9ad9d700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae9400cbc0 tx=0x7fae9400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12404ebb0 con 0x7fb110005210 2023-10-14T11:23:05.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f8a07fff700 1 -- 172.21.15.67:0/1632157036 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c004230 con 0x7f8a1006a810 2023-10-14T11:23:05.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f8a07fff700 1 -- 172.21.15.67:0/1632157036 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c004390 con 0x7f8a1006a810 2023-10-14T11:23:05.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f8a07fff700 1 -- 172.21.15.67:0/1632157036 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0036a0 con 0x7f8a1006a810 2023-10-14T11:23:05.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62680cda20 con 0x7f62680b1960 2023-10-14T11:23:05.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62680cdfe0 con 0x7f62680b1960 2023-10-14T11:23:05.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb12000a030 con 0x7fb110005210 2023-10-14T11:23:05.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f8a173ef700 1 -- 172.21.15.67:0/1632157036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1006a810 msgr2=0x7f8a1006acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f8a173ef700 1 --2- 172.21.15.67:0/1632157036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1006a810 0x7f8a1006acc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009840 tx=0x7f8a0c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:05.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f8a173ef700 1 -- 172.21.15.67:0/1632157036 shutdown_connections 2023-10-14T11:23:05.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f8a173ef700 1 --2- 172.21.15.67:0/1632157036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a1006a810 0x7f8a1006acc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f8a173ef700 1 -- 172.21.15.67:0/1632157036 >> 172.21.15.67:0/1632157036 conn(0x7f8a100b0f60 msgr2=0x7f8a100b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7fb11a7fc700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 0x7fb10806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb120089910 con 0x7fb110005210 2023-10-14T11:23:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f8a173ef700 1 -- 172.21.15.67:0/1632157036 shutdown_connections 2023-10-14T11:23:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f8a173ef700 1 -- 172.21.15.67:0/1632157036 wait complete. 2023-10-14T11:23:05.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.986+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8003db0 con 0x7f1bb8159c10 2023-10-14T11:23:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ba8010470 con 0x7f1bb8159c10 2023-10-14T11:23:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.987+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb804ebb0 con 0x7f1bb8159c10 2023-10-14T11:23:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f1bae7fc700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 0x7f1b9c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ba808aac0 con 0x7f1bb8159c10 2023-10-14T11:23:05.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.988+0000 7f1bbd988700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 0x7f1b9c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f1bbd988700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 0x7f1b9c06d410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001560 tx=0x7f1bb0001670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f8745281700 1 -- 172.21.15.67:0/1603126924 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730010070 con 0x7f874006af20 2023-10-14T11:23:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9400aa60 con 0x7fae9c06a810 2023-10-14T11:23:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c0ce5b0 con 0x7fae9c06a810 2023-10-14T11:23:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c0b2050 con 0x7fae9c06a810 2023-10-14T11:23:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400abc0 con 0x7fae9c06a810 2023-10-14T11:23:05.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940070d0 con 0x7fae9c06a810 2023-10-14T11:23:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2bc055580 con 0x7ff2c40b4070 2023-10-14T11:23:05.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7fb129228700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 0x7fb10806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f8745281700 1 -- 172.21.15.67:0/1603126924 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000da40 con 0x7f874006af20 2023-10-14T11:23:05.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f8745281700 1 -- 172.21.15.67:0/1603126924 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000ddd0 con 0x7f874006af20 2023-10-14T11:23:05.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62580037e0 con 0x7f62680b1960 2023-10-14T11:23:05.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.989+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62680ce1d0 con 0x7f62680b1960 2023-10-14T11:23:05.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7f8a173ef700 1 Processor -- start 2023-10-14T11:23:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7f87484e7700 1 -- 172.21.15.67:0/1603126924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f874006af20 msgr2=0x7f87400c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7f87484e7700 1 --2- 172.21.15.67:0/1603126924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f874006af20 0x7f87400c9a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f87300088f0 tx=0x7f873000d330 comp rx=0 tx=0).stop 2023-10-14T11:23:05.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7f624f7fe700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 0x7f625406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0052f0 con 0x7fae9c06a810 2023-10-14T11:23:05.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6258088800 con 0x7f62680b1960 2023-10-14T11:23:05.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f62667fc700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 0x7f625406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f62667fc700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 0x7f625406d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f625c009870 tx=0x7f625c01d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.990+0000 7f8a173ef700 1 -- start start 2023-10-14T11:23:05.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a1006a810 0x7f8a100c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a10161e90 0x7f8a100b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1006b200 con 0x7f8a1006a810 2023-10-14T11:23:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100c3380 con 0x7f8a10161e90 2023-10-14T11:23:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.991+0000 7f8a173ef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100c3660 con 0x7f8a100cdae0 2023-10-14T11:23:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43800/0 (socket says 172.21.15.67:43800) 2023-10-14T11:23:05.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 -- 172.21.15.67:0/3850125679 learned_addr learned my addr 172.21.15.67:0/3850125679 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1518b700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a1006a810 0x7f8a100c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1598c700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a10161e90 0x7f8a100b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f87484e7700 1 -- 172.21.15.67:0/1603126924 shutdown_connections 2023-10-14T11:23:05.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f87484e7700 1 --2- 172.21.15.67:0/1603126924 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8740159c10 0x7f8740070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f87484e7700 1 --2- 172.21.15.67:0/1603126924 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f874006af20 0x7f87400c9a80 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f87300088f0 tx=0x7f873000d330 comp rx=0 tx=0).stop 2023-10-14T11:23:05.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f87484e7700 1 -- 172.21.15.67:0/1603126924 >> 172.21.15.67:0/1603126924 conn(0x7f87400cbeb0 msgr2=0x7f87400cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 -- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a10161e90 msgr2=0x7f8a100b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a10161e90 0x7f8a100b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 -- 172.21.15.67:0/3850125679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a1006a810 msgr2=0x7f8a100c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a1006a810 0x7f8a100c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 -- 172.21.15.67:0/3850125679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0094a0 con 0x7f8a100cdae0 2023-10-14T11:23:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a1498a700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006c3c0 tx=0x7f8a0c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7fb129228700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 0x7fb10806d490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb12404fec0 tx=0x7fb114009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fae94007230 con 0x7fae9c06a810 2023-10-14T11:23:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c011630 con 0x7f8a100cdae0 2023-10-14T11:23:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c01e070 con 0x7f8a100cdae0 2023-10-14T11:23:05.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0119b0 con 0x7f8a100cdae0 2023-10-14T11:23:05.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.992+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a100c3940 con 0x7f8a100cdae0 2023-10-14T11:23:05.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.993+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a100c3f00 con 0x7f8a100cdae0 2023-10-14T11:23:05.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.993+0000 7fae837fe700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 0x7fae8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.993+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae940896f0 con 0x7fae9c06a810 2023-10-14T11:23:05.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.993+0000 7fae9a59c700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 0x7fae8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.994+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ba8055e00 con 0x7f1bb8159c10 2023-10-14T11:23:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.994+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a100c40f0 con 0x7f8a100cdae0 2023-10-14T11:23:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.995+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a0c011b10 con 0x7f8a100cdae0 2023-10-14T11:23:05.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.994+0000 7fae9a59c700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 0x7fae8806d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0090b0 tx=0x7fae8c01c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.995+0000 7f8a05ffb700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 0x7f89f406d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.996+0000 7f87484e7700 1 -- 172.21.15.67:0/1603126924 shutdown_connections 2023-10-14T11:23:05.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.996+0000 7f87484e7700 1 -- 172.21.15.67:0/1603126924 wait complete. 2023-10-14T11:23:05.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.996+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a0c08a800 con 0x7f8a100cdae0 2023-10-14T11:23:05.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.996+0000 7f8a1518b700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 0x7f89f406d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.996+0000 7f8a1518b700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 0x7f89f406d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009340 tx=0x7f8a000092d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.997+0000 7f87484e7700 1 Processor -- start 2023-10-14T11:23:05.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.998+0000 7f87484e7700 1 -- start start 2023-10-14T11:23:05.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.998+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fae940548c0 con 0x7fae9c06a810 2023-10-14T11:23:05.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.998+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1200549a0 con 0x7fb110005210 2023-10-14T11:23:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.998+0000 7f87484e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8740159830 0x7f87400c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f87484e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f87484e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87401f2800 0x7f87401f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f87484e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87401f31d0 con 0x7f8740159830 2023-10-14T11:23:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f87484e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87400c95d0 con 0x7f8740159c10 2023-10-14T11:23:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f87484e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400c8a50 con 0x7f87401f2800 2023-10-14T11:23:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41946/0 (socket says 172.21.15.67:41946) 2023-10-14T11:23:05.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 -- 172.21.15.67:0/323251992 learned_addr learned my addr 172.21.15.67:0/323251992 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8746a84700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87401f2800 0x7f87401f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 -- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87401f2800 msgr2=0x7f87401f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87401f2800 0x7f87401f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 -- 172.21.15.67:0/323251992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8740159830 msgr2=0x7f87400c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8740159830 0x7f87400c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 -- 172.21.15.67:0/323251992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300085d0 con 0x7f8740159c10 2023-10-14T11:23:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:04.999+0000 7f8745a82700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8730000c00 tx=0x7f87300047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.001+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a0c0558a0 con 0x7f8a100cdae0 2023-10-14T11:23:05.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730008d90 con 0x7f8740159c10 2023-10-14T11:23:05.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730003950 con 0x7f8740159c10 2023-10-14T11:23:05.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730003ce0 con 0x7f8740159c10 2023-10-14T11:23:05.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87400c8d30 con 0x7f8740159c10 2023-10-14T11:23:05.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87400c92f0 con 0x7f8740159c10 2023-10-14T11:23:05.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.003+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62680ce1d0 con 0x7f62680b1960 2023-10-14T11:23:05.076 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.004+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874004ebb0 con 0x7f8740159c10 2023-10-14T11:23:05.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.005+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f873000b160 con 0x7f8740159c10 2023-10-14T11:23:05.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.005+0000 7f8736ffd700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 0x7f872406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.005+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8730089940 con 0x7f8740159c10 2023-10-14T11:23:05.077 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.005+0000 7f8746283700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 0x7f872406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.006+0000 7f8746283700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 0x7f872406d490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f873c001600 tx=0x7f873c007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.008+0000 7fe39ebef700 1 Processor -- start 2023-10-14T11:23:05.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.008+0000 7fe39ebef700 1 -- start start 2023-10-14T11:23:05.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.008+0000 7fe39ebef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3980c52c0 0x7fe3980c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.079 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39ebef700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980cfa80 con 0x7fe39815e4a0 2023-10-14T11:23:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39ebef700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980cfd60 con 0x7fe39815e0c0 2023-10-14T11:23:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39ebef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980d0040 con 0x7fe3980c52c0 2023-10-14T11:23:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39c98b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe39815e0c0 0x7fe398072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47660/0 (socket says 172.21.15.67:47660) 2023-10-14T11:23:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39d18c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe3980c52c0 0x7fe3980c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39c98b700 1 -- 172.21.15.67:0/3664414765 learned_addr learned my addr 172.21.15.67:0/3664414765 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39d18c700 1 -- 172.21.15.67:0/3664414765 >> v1:172.21.15.72:6789/0 conn(0x7fe39815e0c0 legacy=0x7fe398072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39d18c700 1 -- 172.21.15.67:0/3664414765 >> v1:172.21.15.67:6789/0 conn(0x7fe39815e4a0 legacy=0x7fe3980cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39d18c700 1 -- 172.21.15.67:0/3664414765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39806f570 con 0x7fe3980c52c0 2023-10-14T11:23:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe39d18c700 1 --2- 172.21.15.67:0/3664414765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3980c52c0 0x7fe3980c5710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39000bfd0 tx=0x7fe39000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15035c974b5aa180 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.009+0000 7fe3977fe700 1 -- 172.21.15.67:0/3664414765 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390010070 con 0x7fe3980c52c0 2023-10-14T11:23:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.010+0000 7fe3977fe700 1 -- 172.21.15.67:0/3664414765 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000b2e0 con 0x7fe3980c52c0 2023-10-14T11:23:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.010+0000 7fe3977fe700 1 -- 172.21.15.67:0/3664414765 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000dca0 con 0x7fe3980c52c0 2023-10-14T11:23:05.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.010+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8730054c40 con 0x7f8740159c10 2023-10-14T11:23:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.010+0000 7fe39ebef700 1 -- 172.21.15.67:0/3664414765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3980c52c0 msgr2=0x7fe3980c5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.010+0000 7fe39ebef700 1 --2- 172.21.15.67:0/3664414765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3980c52c0 0x7fe3980c5710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39000bfd0 tx=0x7fe39000d330 comp rx=0 tx=0).stop 2023-10-14T11:23:05.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.023+0000 7fe39ebef700 1 -- 172.21.15.67:0/3664414765 shutdown_connections 2023-10-14T11:23:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.023+0000 7fe39ebef700 1 --2- 172.21.15.67:0/3664414765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3980c52c0 0x7fe3980c5710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.023+0000 7fe39ebef700 1 -- 172.21.15.67:0/3664414765 >> 172.21.15.67:0/3664414765 conn(0x7fe3980d0440 msgr2=0x7fe3980d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.023+0000 7fe39ebef700 1 -- 172.21.15.67:0/3664414765 shutdown_connections 2023-10-14T11:23:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.023+0000 7fe39ebef700 1 -- 172.21.15.67:0/3664414765 wait complete. 2023-10-14T11:23:05.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.025+0000 7fe39ebef700 1 Processor -- start 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.026+0000 7fe39ebef700 1 -- start start 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3980c52c0 0x7fe398154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39815e0c0 0x7fe39814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981f8190 con 0x7fe3980c52c0 2023-10-14T11:23:05.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814d6f0 con 0x7fe39815e4a0 2023-10-14T11:23:05.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39ebef700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814a8a0 con 0x7fe39815e0c0 2023-10-14T11:23:05.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39d18c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39d18c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41958/0 (socket says 172.21.15.67:41958) 2023-10-14T11:23:05.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39d18c700 1 -- 172.21.15.67:0/2307206637 learned_addr learned my addr 172.21.15.67:0/2307206637 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:05.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.028+0000 7fe39c98b700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3980c52c0 0x7fe398154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 -- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39815e0c0 msgr2=0x7fe39814d1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-14T11:23:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39815e0c0 0x7fe39814d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 -- 172.21.15.67:0/2307206637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3980c52c0 msgr2=0x7fe398154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3980c52c0 0x7fe398154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 -- 172.21.15.67:0/2307206637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39000bc80 con 0x7fe39815e4a0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.029+0000 7fe39d18c700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3980cdfc0 tx=0x7fe390004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.030+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390004440 con 0x7fe39815e4a0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.030+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3900045a0 con 0x7fe39815e4a0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.030+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390004930 con 0x7fe39815e4a0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.030+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39815eab0 con 0x7fe39815e4a0 2023-10-14T11:23:05.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.030+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3981f77f0 con 0x7fe39815e4a0 2023-10-14T11:23:05.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.034+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe39001b070 con 0x7fe39815e4a0 2023-10-14T11:23:05.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.035+0000 7fe3957fa700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 0x7fe38806d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:05.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.035+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe39008a9a0 con 0x7fe39815e4a0 2023-10-14T11:23:05.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.036+0000 7fe39c98b700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 0x7fe38806d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:05.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.036+0000 7fe39c98b700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 0x7fe38806d5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe384005910 tx=0x7fe384009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:05.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.038+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3740052f0 con 0x7fe39815e4a0 2023-10-14T11:23:05.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.043+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe390055ac0 con 0x7fe39815e4a0 2023-10-14T11:23:05.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.409+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2a80055a0 con 0x7ff2c40b4070 2023-10-14T11:23:05.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.410+0000 7ff2b2ffd700 1 -- 172.21.15.67:0/3956910846 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2bc024360 con 0x7ff2c40b4070 2023-10-14T11:23:05.412 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.410+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1bb806bad0 con 0x7f1bb8159c10 2023-10-14T11:23:05.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.411+0000 7f1bae7fc700 1 -- 172.21.15.67:0/1463548919 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ba8028020 con 0x7f1bb8159c10 2023-10-14T11:23:05.414 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:05.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb1240c2a60 con 0x7fb110005210 2023-10-14T11:23:05.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 msgr2=0x7ff2a406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 0x7ff2a406d490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8001860 tx=0x7ff2b8001450 comp rx=0 tx=0).stop 2023-10-14T11:23:05.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 msgr2=0x7ff2c40b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40c6490 tx=0x7ff2bc001580 comp rx=0 tx=0).stop 2023-10-14T11:23:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 shutdown_connections 2023-10-14T11:23:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff2a406afd0 0x7ff2a406d490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff2c40b4070 0x7ff2c40b4520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff2ac005260 0x7ff2c40c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 --2- 172.21.15.67:0/3956910846 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2c40c9290 0x7ff2c41539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 >> 172.21.15.67:0/3956910846 conn(0x7ff2c40cbeb0 msgr2=0x7ff2c40cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.414+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 shutdown_connections 2023-10-14T11:23:05.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.414+0000 7ff2c8a26700 1 -- 172.21.15.67:0/3956910846 wait complete. 2023-10-14T11:23:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 msgr2=0x7f1b9c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 0x7f1b9c06d410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001560 tx=0x7f1bb0001670 comp rx=0 tx=0).stop 2023-10-14T11:23:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 msgr2=0x7f1bb80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009b90 tx=0x7f1ba8004750 comp rx=0 tx=0).stop 2023-10-14T11:23:05.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.413+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae7c005870 con 0x7fae9c06a810 2023-10-14T11:23:05.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 shutdown_connections 2023-10-14T11:23:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1bb8159c10 0x7f1bb80ce680 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b9c06af50 0x7f1b9c06d410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1bb806af20 0x7f1bb814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 --2- 172.21.15.67:0/1463548919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1bb8159830 0x7f1bb80ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 >> 172.21.15.67:0/1463548919 conn(0x7f1bb80cbeb0 msgr2=0x7f1bb8158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 shutdown_connections 2023-10-14T11:23:05.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.415+0000 7f1bbfbec700 1 -- 172.21.15.67:0/1463548919 wait complete. 2023-10-14T11:23:05.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.419+0000 7fb11a7fc700 1 -- 172.21.15.67:0/1175392491 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb120057fc0 con 0x7fb110005210 2023-10-14T11:23:05.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.419+0000 7fae837fe700 1 -- 172.21.15.67:0/925888163 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae94018020 con 0x7fae9c06a810 2023-10-14T11:23:05.423 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:05.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.421+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 msgr2=0x7fae8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.421+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 0x7fae8806d3c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0090b0 tx=0x7fae8c01c040 comp rx=0 tx=0).stop 2023-10-14T11:23:05.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.421+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 msgr2=0x7fae9c14ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.421+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae9400cbc0 tx=0x7fae9400ced0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 shutdown_connections 2023-10-14T11:23:05.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fae9c0ae660 0x7fae9c0b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fae8806af00 0x7fae8806d3c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fae9c06a810 0x7fae9c14ec40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 --2- 172.21.15.67:0/925888163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fae9c0720e0 0x7fae9c0b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 >> 172.21.15.67:0/925888163 conn(0x7fae9c0b0f60 msgr2=0x7fae9c0aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.422+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f62680c5050 con 0x7f62680b1960 2023-10-14T11:23:05.427 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2023-10-14T11:23:05.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.423+0000 7f624f7fe700 1 -- 172.21.15.67:0/3360759801 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62680c5050 con 0x7f62680b1960 2023-10-14T11:23:05.428 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.426+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f87400c97d0 con 0x7f8740159c10 2023-10-14T11:23:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 msgr2=0x7fb10806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 0x7fb10806d490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb12404fec0 tx=0x7fb114009040 comp rx=0 tx=0).stop 2023-10-14T11:23:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 msgr2=0x7fb1240c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb12000fce0 tx=0x7fb12000d600 comp rx=0 tx=0).stop 2023-10-14T11:23:05.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 shutdown_connections 2023-10-14T11:23:05.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.427+0000 7faea1216700 1 -- 172.21.15.67:0/925888163 wait complete. 2023-10-14T11:23:05.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 shutdown_connections 2023-10-14T11:23:05.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb12415a510 0x7fb12415c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.432 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb110005210 0x7fb1240c4a70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb10806afd0 0x7fb10806d490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 --2- 172.21.15.67:0/1175392491 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb12415a090 0x7fb12415c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 >> 172.21.15.67:0/1175392491 conn(0x7fb1240cbeb0 msgr2=0x7fb1240cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 shutdown_connections 2023-10-14T11:23:05.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.429+0000 7fb12bc8d700 1 -- 172.21.15.67:0/1175392491 wait complete. 2023-10-14T11:23:05.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.431+0000 7f8736ffd700 1 -- 172.21.15.67:0/323251992 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8730058260 con 0x7f8740159c10 2023-10-14T11:23:05.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-14T11:23:05.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-14T11:23:05.437 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:05.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.437+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 msgr2=0x7f872406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.437+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 0x7f872406d490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f873c001600 tx=0x7f873c007a20 comp rx=0 tx=0).stop 2023-10-14T11:23:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.437+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 msgr2=0x7f87401efac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.437+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8730000c00 tx=0x7f87300047c0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 shutdown_connections 2023-10-14T11:23:05.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f87401f2800 0x7f87401f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f872406afd0 0x7f872406d490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8740159830 0x7f87400c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 --2- 172.21.15.67:0/323251992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8740159c10 0x7f87401efac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 >> 172.21.15.67:0/323251992 conn(0x7f87400cbeb0 msgr2=0x7f874006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 msgr2=0x7f625406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 0x7f625406d410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f625c009870 tx=0x7f625c01d040 comp rx=0 tx=0).stop 2023-10-14T11:23:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 msgr2=0x7f6268157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f625800c4d0 tx=0x7f625800c7e0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 shutdown_connections 2023-10-14T11:23:05.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f87484e7700 1 -- 172.21.15.67:0/323251992 wait complete. 2023-10-14T11:23:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 shutdown_connections 2023-10-14T11:23:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f625406af50 0x7f625406d410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6268162380 0x7f6268156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62680b1960 0x7f6268157700 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f625800c4d0 tx=0x7f625800c7e0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 --2- 172.21.15.67:0/3360759801 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62680c2d50 0x7f62680cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.441+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 >> 172.21.15.67:0/3360759801 conn(0x7f62680cc250 msgr2=0x7f62680b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.443+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 shutdown_connections 2023-10-14T11:23:05.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.445+0000 7f626d68d700 1 -- 172.21.15.67:0/3360759801 wait complete. 2023-10-14T11:23:05.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-10-14T11:23:05.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-10-14T11:23:05.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.454+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8a1004ebb0 con 0x7f8a100cdae0 2023-10-14T11:23:05.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.455+0000 7f8a05ffb700 1 -- 172.21.15.67:0/3850125679 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a0c020090 con 0x7f8a100cdae0 2023-10-14T11:23:05.457 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:05.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-14T11:23:05.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 msgr2=0x7f89f406d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 0x7f89f406d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009340 tx=0x7f8a000092d0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 msgr2=0x7f8a1015c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006c3c0 tx=0x7f8a0c004750 comp rx=0 tx=0).stop 2023-10-14T11:23:05.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 shutdown_connections 2023-10-14T11:23:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a10161e90 0x7f8a100b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f89f406af30 0x7f89f406d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8a1006a810 0x7f8a100c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 --2- 172.21.15.67:0/3850125679 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8a100cdae0 0x7f8a1015c760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 >> 172.21.15.67:0/3850125679 conn(0x7f8a100b0f60 msgr2=0x7f8a100cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 shutdown_connections 2023-10-14T11:23:05.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.458+0000 7f8a173ef700 1 -- 172.21.15.67:0/3850125679 wait complete. 2023-10-14T11:23:05.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-14T11:23:05.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-14T11:23:05.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.476+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe3740055a0 con 0x7fe39815e4a0 2023-10-14T11:23:05.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.476+0000 7fe3957fa700 1 -- 172.21.15.67:0/2307206637 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe390021090 con 0x7fe39815e4a0 2023-10-14T11:23:05.478 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:05.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 msgr2=0x7fe38806d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 0x7fe38806d5f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe384005910 tx=0x7fe384009040 comp rx=0 tx=0).stop 2023-10-14T11:23:05.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 msgr2=0x7fe39814a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:05.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3980cdfc0 tx=0x7fe390004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 shutdown_connections 2023-10-14T11:23:05.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe39815e4a0 0x7fe39814a360 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe38806b130 0x7fe38806d5f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3980c52c0 0x7fe398154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 --2- 172.21.15.67:0/2307206637 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe39815e0c0 0x7fe39814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:05.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 >> 172.21.15.67:0/2307206637 conn(0x7fe3980d0440 msgr2=0x7fe3980724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:05.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 shutdown_connections 2023-10-14T11:23:05.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:05.479+0000 7fe39ebef700 1 -- 172.21.15.67:0/2307206637 wait complete. 2023-10-14T11:23:05.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-14T11:23:06.437 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T11:23:06.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T11:23:06.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T11:23:06.453 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T11:23:06.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T11:23:06.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T11:23:06.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T11:23:06.495 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T11:23:06.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.648+0000 7efbf795f700 1 Processor -- start 2023-10-14T11:23:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.648+0000 7efbf795f700 1 -- start start 2023-10-14T11:23:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.649+0000 7efbf795f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7efbf00cc9a0 0x7efbf00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.649+0000 7efbf795f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf0072520 0x7efbf0159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.649+0000 7efbf795f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf015d590 con 0x7efbf006e410 2023-10-14T11:23:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.649+0000 7efbf795f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf015d870 con 0x7efbf00cc9a0 2023-10-14T11:23:06.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.649+0000 7efbf795f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf015db50 con 0x7efbf0072520 2023-10-14T11:23:06.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.650+0000 7efbf5efc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efbf006e410 0x7efbf006e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40852/0 (socket says 172.21.15.67:40852) 2023-10-14T11:23:06.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.650+0000 7efbf5efc700 1 -- 172.21.15.67:0/3361279854 learned_addr learned my addr 172.21.15.67:0/3361279854 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:06.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.651+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3361279854 >> v2:172.21.15.67:3300/0 conn(0x7efbf00cc9a0 0x7efbf00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.651+0000 7efbf56fb700 1 -- 172.21.15.67:0/3361279854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf0072520 msgr2=0x7efbf0159830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:06.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.651+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3361279854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf0072520 0x7efbf0159830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.651+0000 7efbf56fb700 1 -- 172.21.15.67:0/3361279854 >> v1:172.21.15.67:6789/0 conn(0x7efbf006e410 legacy=0x7efbf006e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.651+0000 7efbf56fb700 1 -- 172.21.15.67:0/3361279854 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf015de30 con 0x7efbf00cc9a0 2023-10-14T11:23:06.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.652+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3361279854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf00cc9a0 0x7efbf00c9a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efbe0009840 tx=0x7efbe0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c6b6fdc51adcc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.655+0000 7efbe7fff700 1 -- 172.21.15.67:0/3361279854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0004230 con 0x7efbf00cc9a0 2023-10-14T11:23:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.655+0000 7efbe7fff700 1 -- 172.21.15.67:0/3361279854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0004390 con 0x7efbf00cc9a0 2023-10-14T11:23:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.655+0000 7efbe7fff700 1 -- 172.21.15.67:0/3361279854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe00036a0 con 0x7efbf00cc9a0 2023-10-14T11:23:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 -- 172.21.15.67:0/3361279854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf00cc9a0 msgr2=0x7efbf00c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 --2- 172.21.15.67:0/3361279854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf00cc9a0 0x7efbf00c9a80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efbe0009840 tx=0x7efbe0009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:06.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 -- 172.21.15.67:0/3361279854 shutdown_connections 2023-10-14T11:23:06.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 --2- 172.21.15.67:0/3361279854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf00cc9a0 0x7efbf00c9a80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 --2- 172.21.15.67:0/3361279854 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf0072520 0x7efbf0159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.659 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7efbf795f700 1 -- 172.21.15.67:0/3361279854 >> 172.21.15.67:0/3361279854 conn(0x7efbf00cbeb0 msgr2=0x7efbf00cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7f7f0cfc0700 1 Processor -- start 2023-10-14T11:23:06.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.656+0000 7f7f0cfc0700 1 -- start start 2023-10-14T11:23:06.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.657+0000 7f7f0cfc0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7f08161d90 0x7f7f0806b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.657+0000 7f7f0cfc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f080cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.657+0000 7f7f0cfc0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0806b760 con 0x7f7f080c28a0 2023-10-14T11:23:06.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.657+0000 7f7f0cfc0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f08166660 con 0x7f7f08161d90 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.657+0000 7f7f0cfc0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c2690 con 0x7f7f080ca190 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7f08161d90 0x7f7f0806b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7f08161d90 0x7f7f0806b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41564/0 (socket says 172.21.15.67:41564) 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 -- 172.21.15.67:0/2519786040 learned_addr learned my addr 172.21.15.67:0/2519786040 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f06d9d700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f080cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.662 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 -- 172.21.15.67:0/2519786040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 msgr2=0x7f7f080cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f080cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 -- 172.21.15.67:0/2519786040 >> v1:172.21.15.72:6789/0 conn(0x7f7f080c28a0 legacy=0x7f7f080c9a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f0659c700 1 -- 172.21.15.67:0/2519786040 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f081659e0 con 0x7f7f08161d90 2023-10-14T11:23:06.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7efbf795f700 1 -- 172.21.15.67:0/3361279854 shutdown_connections 2023-10-14T11:23:06.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7f7f06d9d700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f080cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:06.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.659+0000 7f7f0659c700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f08161d90 0x7f7f0806b220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80098f0 tx=0x7f7ef8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a943830e79970881 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.658+0000 7efbf795f700 1 -- 172.21.15.67:0/3361279854 wait complete. 2023-10-14T11:23:06.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.659+0000 7f7f0559a700 1 -- 172.21.15.67:0/2519786040 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004230 con 0x7f7f08161d90 2023-10-14T11:23:06.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.659+0000 7f7f0559a700 1 -- 172.21.15.67:0/2519786040 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef8004390 con 0x7f7f08161d90 2023-10-14T11:23:06.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.659+0000 7f7f0559a700 1 -- 172.21.15.67:0/2519786040 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80036a0 con 0x7f7f08161d90 2023-10-14T11:23:06.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.660+0000 7efbf795f700 1 Processor -- start 2023-10-14T11:23:06.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.660+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/2519786040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f08161d90 msgr2=0x7f7f0806b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.660+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f08161d90 0x7f7f0806b220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80098f0 tx=0x7f7ef8009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.661+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/2519786040 shutdown_connections 2023-10-14T11:23:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.661+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f080cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.661+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/2519786040 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f08161d90 0x7f7f0806b220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.661+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/2519786040 >> 172.21.15.67:0/2519786040 conn(0x7f7f080cbeb0 msgr2=0x7f7f080cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.660+0000 7efbf795f700 1 -- start start 2023-10-14T11:23:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 0x7efbf00c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 0x7efbf01f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c2f60 con 0x7efbf006e410 2023-10-14T11:23:06.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c31b0 con 0x7efbf015bd60 2023-10-14T11:23:06.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf795f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00c3490 con 0x7efbf00cc9a0 2023-10-14T11:23:06.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf56fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf56fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41572/0 (socket says 172.21.15.67:41572) 2023-10-14T11:23:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf56fb700 1 -- 172.21.15.67:0/3726451953 learned_addr learned my addr 172.21.15.67:0/3726451953 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.662+0000 7efbf56fb700 1 -- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 msgr2=0x7efbf00c4910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:23:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf5efc700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 0x7efbf01f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf4efa700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 0x7efbf00c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 0x7efbf00c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf56fb700 1 -- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 msgr2=0x7efbf01f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 0x7efbf01f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf56fb700 1 -- 172.21.15.67:0/3726451953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe00094a0 con 0x7efbf006e410 2023-10-14T11:23:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf5efc700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 0x7efbf01f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:06.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf4efa700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 0x7efbf00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:06.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.663+0000 7efbf56fb700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efbe0000c00 tx=0x7efbe0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.665+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/2519786040 shutdown_connections 2023-10-14T11:23:06.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.666+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0011630 con 0x7efbf006e410 2023-10-14T11:23:06.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.666+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe0011790 con 0x7efbf006e410 2023-10-14T11:23:06.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.666+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe0011b20 con 0x7efbf006e410 2023-10-14T11:23:06.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.666+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf00c3770 con 0x7efbf006e410 2023-10-14T11:23:06.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.666+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf00c3d30 con 0x7efbf006e410 2023-10-14T11:23:06.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.669+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efbe0022020 con 0x7efbf006e410 2023-10-14T11:23:06.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.669+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbd00052f0 con 0x7efbf006e410 2023-10-14T11:23:06.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.670+0000 7efbe5ffb700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 0x7efbd406d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.670+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbe008ad90 con 0x7efbf006e410 2023-10-14T11:23:06.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.671+0000 7efbf4efa700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 0x7efbd406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.671+0000 7efbf4efa700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 0x7efbd406d490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efbec006fd0 tx=0x7efbec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.673+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/2519786040 wait complete. 2023-10-14T11:23:06.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.676+0000 7f7f0cfc0700 1 Processor -- start 2023-10-14T11:23:06.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.676+0000 7f7f0cfc0700 1 -- start start 2023-10-14T11:23:06.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efbe0055eb0 con 0x7efbf006e410 2023-10-14T11:23:06.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f081f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f080c4e90 0x7f7f080c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c5860 con 0x7f7f080c4e90 2023-10-14T11:23:06.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c2db0 con 0x7f7f08161d90 2023-10-14T11:23:06.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0cfc0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c88c0 con 0x7f7f080ca190 2023-10-14T11:23:06.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f05d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f05d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:41984/0 (socket says 172.21.15.67:41984) 2023-10-14T11:23:06.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f05d9b700 1 -- 172.21.15.67:0/1722814497 learned_addr learned my addr 172.21.15.67:0/1722814497 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.679+0000 7f7f0659c700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f081f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f06d9d700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f080c4e90 0x7f7f080c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 -- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 msgr2=0x7f7f081f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f081f89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 -- 172.21.15.67:0/1722814497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f080c4e90 msgr2=0x7f7f080c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f080c4e90 0x7f7f080c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 -- 172.21.15.67:0/1722814497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009a70 con 0x7f7f08161d90 2023-10-14T11:23:06.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.680+0000 7f7f05d9b700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b550 tx=0x7f7efc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.685+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011830 con 0x7f7f08161d90 2023-10-14T11:23:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.686+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc0119b0 con 0x7f7f08161d90 2023-10-14T11:23:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.686+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011d60 con 0x7f7f08161d90 2023-10-14T11:23:06.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.686+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef8009550 con 0x7f7f08161d90 2023-10-14T11:23:06.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.686+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f080c32e0 con 0x7f7f08161d90 2023-10-14T11:23:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.689+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec0052f0 con 0x7f7f08161d90 2023-10-14T11:23:06.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.689+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7efc01a400 con 0x7f7f08161d90 2023-10-14T11:23:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.690+0000 7f7ef6ffd700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 0x7f7ee806d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.690+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7efc089690 con 0x7f7f08161d90 2023-10-14T11:23:06.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.690+0000 7f7f0659c700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 0x7f7ee806d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.691+0000 7f7f0659c700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 0x7f7ee806d490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009c40 tx=0x7f7ef8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.695+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7efc054730 con 0x7f7f08161d90 2023-10-14T11:23:06.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.695+0000 7f63f55f2700 1 Processor -- start 2023-10-14T11:23:06.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.696+0000 7f63f55f2700 1 -- start start 2023-10-14T11:23:06.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63f55f2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f63f00c3310 0x7f63f015b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63f55f2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f015b570 con 0x7f63f006bb90 2023-10-14T11:23:06.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63f55f2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f006a810 con 0x7f63f00cd820 2023-10-14T11:23:06.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63f55f2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f006aaf0 con 0x7f63f00c3310 2023-10-14T11:23:06.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63ef7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f63f006bb90 0x7f63f00c15e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40880/0 (socket says 172.21.15.67:40880) 2023-10-14T11:23:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.697+0000 7f63ef7fe700 1 -- 172.21.15.67:0/2213657302 learned_addr learned my addr 172.21.15.67:0/2213657302 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594229221 0 0) 0x7f63e0001110 con 0x7f63f006bb90 2023-10-14T11:23:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d80035b0 con 0x7f63f006bb90 2023-10-14T11:23:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63ee7fc700 1 --2- 172.21.15.67:0/2213657302 >> v2:172.21.15.67:3300/0 conn(0x7f63f00c3310 0x7f63f015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63ee7fc700 1 -- 172.21.15.67:0/2213657302 >> v1:172.21.15.72:6789/0 conn(0x7f63f00cd820 legacy=0x7f63f00cdc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:06.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63ee7fc700 1 -- 172.21.15.67:0/2213657302 >> v1:172.21.15.67:6789/0 conn(0x7f63f006bb90 legacy=0x7f63f00c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247523439 0 0) 0x7f63d80035b0 con 0x7f63f006bb90 2023-10-14T11:23:06.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.698+0000 7f63ee7fc700 1 -- 172.21.15.67:0/2213657302 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f006add0 con 0x7f63f00c3310 2023-10-14T11:23:06.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.699+0000 7f63ee7fc700 1 --2- 172.21.15.67:0/2213657302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00c3310 0x7f63f015b030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63e800bfa0 tx=0x7f63e800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88e8883c911cca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.699+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8010070 con 0x7f63f00c3310 2023-10-14T11:23:06.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.699+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8003a20 con 0x7f63f00c3310 2023-10-14T11:23:06.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.699+0000 7f63edffb700 1 -- 172.21.15.67:0/2213657302 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0001800 con 0x7f63f00c3310 2023-10-14T11:23:06.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.700+0000 7f63f55f2700 1 -- 172.21.15.67:0/2213657302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00c3310 msgr2=0x7f63f015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.700+0000 7f63f55f2700 1 --2- 172.21.15.67:0/2213657302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00c3310 0x7f63f015b030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f63e800bfa0 tx=0x7f63e800d330 comp rx=0 tx=0).stop 2023-10-14T11:23:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.703+0000 7f63f55f2700 1 -- 172.21.15.67:0/2213657302 shutdown_connections 2023-10-14T11:23:06.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.703+0000 7f63f55f2700 1 --2- 172.21.15.67:0/2213657302 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00c3310 0x7f63f015b030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.703+0000 7f63f55f2700 1 -- 172.21.15.67:0/2213657302 >> 172.21.15.67:0/2213657302 conn(0x7f63f00b1740 msgr2=0x7f63f00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.707+0000 7f63f55f2700 1 -- 172.21.15.67:0/2213657302 shutdown_connections 2023-10-14T11:23:06.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.707+0000 7f63f55f2700 1 -- 172.21.15.67:0/2213657302 wait complete. 2023-10-14T11:23:06.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.709+0000 7f63f55f2700 1 Processor -- start 2023-10-14T11:23:06.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.709+0000 7f63f55f2700 1 -- start start 2023-10-14T11:23:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f006bb90 0x7f63f00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f00c3310 0x7f63f0157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f016e3b0 con 0x7f63f00cd820 2023-10-14T11:23:06.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f016dac0 con 0x7f63f00c3310 2023-10-14T11:23:06.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.710+0000 7f63f55f2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f01576b0 con 0x7f63f006bb90 2023-10-14T11:23:06.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41594/0 (socket says 172.21.15.67:41594) 2023-10-14T11:23:06.714 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 -- 172.21.15.67:0/799524096 learned_addr learned my addr 172.21.15.67:0/799524096 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 -- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f006bb90 msgr2=0x7f63f00afbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:23:06.715 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f006bb90 0x7f63f00afbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 -- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f00c3310 msgr2=0x7f63f0157170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T11:23:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f00c3310 0x7f63f0157170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 -- 172.21.15.67:0/799524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e800bc80 con 0x7f63f00cd820 2023-10-14T11:23:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.711+0000 7f63ef7fe700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c520 tx=0x7f63e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.712+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0004c80 con 0x7f63f00cd820 2023-10-14T11:23:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.712+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0004e00 con 0x7f63f00cd820 2023-10-14T11:23:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.712+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0007310 con 0x7f63f00cd820 2023-10-14T11:23:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.712+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f016dd60 con 0x7f63f00cd820 2023-10-14T11:23:06.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.712+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0155bf0 con 0x7f63f00cd820 2023-10-14T11:23:06.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.713+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f004ebb0 con 0x7f63f00cd820 2023-10-14T11:23:06.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.715+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f63e0007470 con 0x7f63f00cd820 2023-10-14T11:23:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.715+0000 7f63d77fe700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 0x7f63dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.715+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63e0089800 con 0x7f63f00cd820 2023-10-14T11:23:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.715+0000 7f63eeffd700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 0x7f63dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.716+0000 7fdd7ba2a700 1 Processor -- start 2023-10-14T11:23:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.716+0000 7f427e6a8700 1 Processor -- start 2023-10-14T11:23:06.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.716+0000 7fdd7ba2a700 1 -- start start 2023-10-14T11:23:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd7ba2a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 0x7fdd740c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd7ba2a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 0x7fdd7406a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd7ba2a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7415d590 con 0x7fdd74072520 2023-10-14T11:23:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd7ba2a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7415d870 con 0x7fdd74159c10 2023-10-14T11:23:06.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd7ba2a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415db50 con 0x7fdd74159830 2023-10-14T11:23:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd79fc7700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd74072520 0x7fdd7406e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47718/0 (socket says 172.21.15.67:47718) 2023-10-14T11:23:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd79fc7700 1 -- 172.21.15.67:0/1149740118 learned_addr learned my addr 172.21.15.67:0/1149740118 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:06.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd797c6700 1 --2- 172.21.15.67:0/1149740118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 0x7fdd740c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.716+0000 7f427e6a8700 1 -- start start 2023-10-14T11:23:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7f427e6a8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f4278161e90 0x7f42781659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7f427e6a8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278162270 con 0x7f4278165f10 2023-10-14T11:23:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7f427e6a8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278166540 con 0x7f427806af20 2023-10-14T11:23:06.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7f427e6a8700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780cd6c0 con 0x7f4278161e90 2023-10-14T11:23:06.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.717+0000 7fdd78fc5700 1 --2- 172.21.15.67:0/1149740118 >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 0x7fdd7406a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd797c6700 1 -- 172.21.15.67:0/1149740118 >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 msgr2=0x7fdd7406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:06.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd797c6700 1 --2- 172.21.15.67:0/1149740118 >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 0x7fdd7406a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd797c6700 1 -- 172.21.15.67:0/1149740118 >> v1:172.21.15.72:6789/0 conn(0x7fdd74072520 legacy=0x7fdd7406e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd797c6700 1 -- 172.21.15.67:0/1149740118 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7415de30 con 0x7fdd74159830 2023-10-14T11:23:06.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd78fc5700 1 --2- 172.21.15.67:0/1149740118 >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 0x7fdd7406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:06.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7fdd797c6700 1 --2- 172.21.15.67:0/1149740118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 0x7fdd740c9a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400a950 tx=0x7fdd6400ac60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1654bd57d18def5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7f42777fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f4278165f10 0x7f427806a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40902/0 (socket says 172.21.15.67:40902) 2023-10-14T11:23:06.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.718+0000 7f42777fe700 1 -- 172.21.15.67:0/3845237377 learned_addr learned my addr 172.21.15.67:0/3845237377 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:06.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f2ddc669700 1 Processor -- start 2023-10-14T11:23:06.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f2ddc669700 1 -- start start 2023-10-14T11:23:06.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f4277fff700 1 --2- 172.21.15.67:0/3845237377 >> v2:172.21.15.67:3300/0 conn(0x7f4278161e90 0x7f42781659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f4277fff700 1 -- 172.21.15.67:0/3845237377 >> v1:172.21.15.72:6789/0 conn(0x7f427806af20 legacy=0x7f42780cdae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:06.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f4277fff700 1 -- 172.21.15.67:0/3845237377 >> v1:172.21.15.67:6789/0 conn(0x7f4278165f10 legacy=0x7f427806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f4277fff700 1 -- 172.21.15.67:0/3845237377 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278166820 con 0x7f4278161e90 2023-10-14T11:23:06.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.719+0000 7f77f7ff0700 1 Processor -- start 2023-10-14T11:23:06.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f4277fff700 1 --2- 172.21.15.67:0/3845237377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4278161e90 0x7f42781659d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4270009d90 tx=0x7f427000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c751ec8289f757 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f77f7ff0700 1 -- start start 2023-10-14T11:23:06.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f63eeffd700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 0x7f63dc06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63e4006fd0 tx=0x7f63e4006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2dd415a8d0 0x7f2dd40ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40caeb0 0x7f2dd40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2dd40b1250 0x7f2dd40b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd40cf400 con 0x7f2dd40b1250 2023-10-14T11:23:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd406c930 con 0x7f2dd415a8d0 2023-10-14T11:23:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.720+0000 7f2ddc669700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40cc080 con 0x7f2dd40caeb0 2023-10-14T11:23:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2dd40b1250 0x7f2dd40b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2dd40b1250 0x7f2dd40b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41610/0 (socket says 172.21.15.67:41610) 2023-10-14T11:23:06.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 -- 172.21.15.67:0/3559670288 learned_addr learned my addr 172.21.15.67:0/3559670288 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f7ff0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f77f00c2740 0x7f77f00724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f7ff0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77f0070a80 0x7f77f00729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f7ff0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f0165db0 con 0x7f77f00c2b20 2023-10-14T11:23:06.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f7ff0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00ce5e0 con 0x7f77f0070a80 2023-10-14T11:23:06.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f7ff0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f0166050 con 0x7f77f00c2740 2023-10-14T11:23:06.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77f0070a80 0x7f77f00729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f77f0070a80 0x7f77f00729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41616/0 (socket says 172.21.15.67:41616) 2023-10-14T11:23:06.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 -- 172.21.15.67:0/2438973642 learned_addr learned my addr 172.21.15.67:0/2438973642 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 -- 172.21.15.67:0/3559670288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40caeb0 msgr2=0x7f2dd40aeba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:06.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 --2- 172.21.15.67:0/3559670288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40caeb0 0x7f2dd40aeba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 -- 172.21.15.67:0/3559670288 >> v2:172.21.15.72:3300/0 conn(0x7f2dd415a8d0 msgr2=0x7f2dd40ae660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:06.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 --2- 172.21.15.67:0/3559670288 >> v2:172.21.15.72:3300/0 conn(0x7f2dd415a8d0 0x7f2dd40ae660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 -- 172.21.15.67:0/3559670288 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd406cb80 con 0x7f2dd40b1250 2023-10-14T11:23:06.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f5d8c700 1 --2- 172.21.15.67:0/2438973642 >> v2:172.21.15.72:3300/0 conn(0x7f77f00c2740 0x7f77f00724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f2ddac06700 1 --2- 172.21.15.67:0/3559670288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40b1250 0x7f2dd40b16c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4071f90 tx=0x7f2dcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f6cf335b62aa53 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 -- 172.21.15.67:0/2438973642 >> v2:172.21.15.72:3300/0 conn(0x7f77f00c2740 msgr2=0x7f77f00724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:06.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 --2- 172.21.15.67:0/2438973642 >> v2:172.21.15.72:3300/0 conn(0x7f77f00c2740 0x7f77f00724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 -- 172.21.15.67:0/2438973642 >> v1:172.21.15.72:6789/0 conn(0x7f77f00c2b20 legacy=0x7f77f006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.721+0000 7f77f558b700 1 -- 172.21.15.67:0/2438973642 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0166330 con 0x7f77f0070a80 2023-10-14T11:23:06.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.722+0000 7fdd6bfff700 1 -- 172.21.15.67:0/1149740118 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400aea0 con 0x7fdd74159830 2023-10-14T11:23:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.722+0000 7f77f558b700 1 --2- 172.21.15.67:0/2438973642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00729e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ccfb0 tx=0x7f77e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731a9e4064ae7e75 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63e0054940 con 0x7f63f00cd820 2023-10-14T11:23:06.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.722+0000 7fdd6bfff700 1 -- 172.21.15.67:0/1149740118 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64004230 con 0x7fdd74159830 2023-10-14T11:23:06.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.722+0000 7fdd6bfff700 1 -- 172.21.15.67:0/1149740118 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400c760 con 0x7fdd74159830 2023-10-14T11:23:06.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/1149740118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 msgr2=0x7fdd740c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/1149740118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 0x7fdd740c9a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400a950 tx=0x7fdd6400ac60 comp rx=0 tx=0).stop 2023-10-14T11:23:06.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7f4276ffd700 1 -- 172.21.15.67:0/3845237377 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000e070 con 0x7f4278161e90 2023-10-14T11:23:06.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7f4276ffd700 1 -- 172.21.15.67:0/3845237377 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000bb90 con 0x7f4278161e90 2023-10-14T11:23:06.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.723+0000 7f4276ffd700 1 -- 172.21.15.67:0/3845237377 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270003a20 con 0x7f4278161e90 2023-10-14T11:23:06.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 -- 172.21.15.67:0/3845237377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4278161e90 msgr2=0x7f42781659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 --2- 172.21.15.67:0/3845237377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4278161e90 0x7f42781659d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4270009d90 tx=0x7f427000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:06.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/1149740118 shutdown_connections 2023-10-14T11:23:06.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/1149740118 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74159830 0x7fdd740c9a80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/1149740118 >> v2:172.21.15.67:3300/0 conn(0x7fdd74159c10 0x7fdd7406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/1149740118 >> 172.21.15.67:0/1149740118 conn(0x7fdd740cbeb0 msgr2=0x7fdd740cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 -- 172.21.15.67:0/3845237377 shutdown_connections 2023-10-14T11:23:06.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 --2- 172.21.15.67:0/3845237377 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4278161e90 0x7f42781659d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 -- 172.21.15.67:0/3845237377 >> 172.21.15.67:0/3845237377 conn(0x7f42780b0f60 msgr2=0x7f42780b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 -- 172.21.15.67:0/3845237377 shutdown_connections 2023-10-14T11:23:06.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.724+0000 7f427e6a8700 1 -- 172.21.15.67:0/3845237377 wait complete. 2023-10-14T11:23:06.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.725+0000 7f2dd9403700 1 -- 172.21.15.67:0/3559670288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00e070 con 0x7f2dd40b1250 2023-10-14T11:23:06.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.725+0000 7f2dd9403700 1 -- 172.21.15.67:0/3559670288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc00b9c0 con 0x7f2dd40b1250 2023-10-14T11:23:06.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.725+0000 7f2dd9403700 1 -- 172.21.15.67:0/3559670288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00bd70 con 0x7f2dd40b1250 2023-10-14T11:23:06.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 -- 172.21.15.67:0/3559670288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40b1250 msgr2=0x7f2dd40b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 --2- 172.21.15.67:0/3559670288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40b1250 0x7f2dd40b16c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4071f90 tx=0x7f2dcc00b330 comp rx=0 tx=0).stop 2023-10-14T11:23:06.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 -- 172.21.15.67:0/3559670288 shutdown_connections 2023-10-14T11:23:06.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 --2- 172.21.15.67:0/3559670288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40b1250 0x7f2dd40b16c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 --2- 172.21.15.67:0/3559670288 >> v2:172.21.15.72:3300/0 conn(0x7f2dd415a8d0 0x7f2dd40ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 --2- 172.21.15.67:0/3559670288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40caeb0 0x7f2dd40aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 -- 172.21.15.67:0/3559670288 >> 172.21.15.67:0/3559670288 conn(0x7f2dd40cc250 msgr2=0x7f2dd40cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 -- 172.21.15.67:0/3559670288 shutdown_connections 2023-10-14T11:23:06.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f2ddc669700 1 -- 172.21.15.67:0/3559670288 wait complete. 2023-10-14T11:23:06.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.726+0000 7f427e6a8700 1 Processor -- start 2023-10-14T11:23:06.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f77f4d8a700 1 -- 172.21.15.67:0/2438973642 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000b870 con 0x7f77f0070a80 2023-10-14T11:23:06.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f77f4d8a700 1 -- 172.21.15.67:0/2438973642 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e000b9d0 con 0x7f77f0070a80 2023-10-14T11:23:06.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f77f4d8a700 1 -- 172.21.15.67:0/2438973642 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000bd60 con 0x7f77f0070a80 2023-10-14T11:23:06.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f2ddc669700 1 Processor -- start 2023-10-14T11:23:06.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.727+0000 7f427e6a8700 1 -- start start 2023-10-14T11:23:06.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278161e90 0x7f4278204750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 0x7f42780ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780b3d10 con 0x7f427806af20 2023-10-14T11:23:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278204c90 con 0x7f4278161e90 2023-10-14T11:23:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427e6a8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c94b0 con 0x7f4278165f10 2023-10-14T11:23:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f4277fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f4277fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41618/0 (socket says 172.21.15.67:41618) 2023-10-14T11:23:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f4277fff700 1 -- 172.21.15.67:0/2356231057 learned_addr learned my addr 172.21.15.67:0/2356231057 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f427cc45700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 0x7f42780ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f42777fe700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278161e90 0x7f4278204750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 -- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278161e90 msgr2=0x7f4278204750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278161e90 0x7f4278204750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 -- 172.21.15.67:0/2356231057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 msgr2=0x7f42782001b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 -- 172.21.15.67:0/2356231057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009a70 con 0x7f4278165f10 2023-10-14T11:23:06.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f4277fff700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:06.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427cc45700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 0x7f42780ce4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f426800b3e0 tx=0x7f426800b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268011620 con 0x7f4278165f10 2023-10-14T11:23:06.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42680117a0 con 0x7f4278165f10 2023-10-14T11:23:06.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268011b50 con 0x7f4278165f10 2023-10-14T11:23:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.728+0000 7f2ddc669700 1 -- start start 2023-10-14T11:23:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40b1250 0x7f2dd4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40caeb0 0x7f2dd40b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40b35e0 con 0x7f2dd40caeb0 2023-10-14T11:23:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40b38c0 con 0x7f2dd415a8d0 2023-10-14T11:23:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddc669700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40b3ba0 con 0x7f2dd40b1250 2023-10-14T11:23:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddac06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddac06700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42034/0 (socket says 172.21.15.67:42034) 2023-10-14T11:23:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f2ddac06700 1 -- 172.21.15.67:0/1825158025 learned_addr learned my addr 172.21.15.67:0/1825158025 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2dda405700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40b1250 0x7f2dd4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 -- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40b1250 msgr2=0x7f2dd4153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40b1250 0x7f2dd4153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 -- 172.21.15.67:0/1825158025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40caeb0 msgr2=0x7f2dd40b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40caeb0 0x7f2dd40b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 -- 172.21.15.67:0/1825158025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc009b30 con 0x7f2dd415a8d0 2023-10-14T11:23:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2ddac06700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00b730 tx=0x7f2dcc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.729+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42780b3fb0 con 0x7f4278165f10 2023-10-14T11:23:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780b4570 con 0x7f4278165f10 2023-10-14T11:23:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc004390 con 0x7f2dd415a8d0 2023-10-14T11:23:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc0044f0 con 0x7f2dd415a8d0 2023-10-14T11:23:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.730+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc004880 con 0x7f2dd415a8d0 2023-10-14T11:23:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.731+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd40b3e80 con 0x7f2dd415a8d0 2023-10-14T11:23:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.731+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd4153a60 con 0x7f2dd415a8d0 2023-10-14T11:23:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.732+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4268011cb0 con 0x7f4278165f10 2023-10-14T11:23:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.733+0000 7f4274ff9700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.733+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4268089340 con 0x7f4278165f10 2023-10-14T11:23:06.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.733+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/1149740118 shutdown_connections 2023-10-14T11:23:06.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.733+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/1149740118 wait complete. 2023-10-14T11:23:06.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.733+0000 7f4277fff700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.734+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2dcc01c440 con 0x7f2dd415a8d0 2023-10-14T11:23:06.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.734+0000 7f4277fff700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 0x7f426406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f427000b370 tx=0x7f4270011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.734+0000 7f2dcaffd700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 0x7f2db806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.735+0000 7f2dda405700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 0x7f2db806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.735+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dcc059690 con 0x7f2dd415a8d0 2023-10-14T11:23:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.735+0000 7fdd7ba2a700 1 Processor -- start 2023-10-14T11:23:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.736+0000 7f2dda405700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 0x7f2db806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40b50f0 tx=0x7f2dd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd406ce40 con 0x7f2dd415a8d0 2023-10-14T11:23:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.735+0000 7fdd7ba2a700 1 -- start start 2023-10-14T11:23:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74072520 0x7fdd741ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd74159830 0x7fdd7415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7415a3a0 con 0x7fdd74159830 2023-10-14T11:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740c3b40 con 0x7fdd74159c10 2023-10-14T11:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd7ba2a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740c3e20 con 0x7fdd74072520 2023-10-14T11:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42042/0 (socket says 172.21.15.67:42042) 2023-10-14T11:23:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 -- 172.21.15.67:0/2078475750 learned_addr learned my addr 172.21.15.67:0/2078475750 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd78fc5700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd74159830 0x7fdd7415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd797c6700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74072520 0x7fdd741ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 -- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74072520 msgr2=0x7fdd741ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74072520 0x7fdd741ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 -- 172.21.15.67:0/2078475750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd74159830 msgr2=0x7fdd7415b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd74159830 0x7fdd7415b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.737+0000 7fdd79fc7700 1 -- 172.21.15.67:0/2078475750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6400a5b0 con 0x7fdd74159c10 2023-10-14T11:23:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.738+0000 7fdd79fc7700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00cb70 tx=0x7fdd6c00ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2438973642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 msgr2=0x7f77f00729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2438973642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00729e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ccfb0 tx=0x7f77e0009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2438973642 shutdown_connections 2023-10-14T11:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2438973642 >> v2:172.21.15.72:3300/0 conn(0x7f77f00c2740 0x7f77f00724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2438973642 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00729e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.739+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2438973642 >> 172.21.15.67:0/2438973642 conn(0x7f77f00cbeb0 msgr2=0x7f77f00cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.741+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427804ebb0 con 0x7f4278165f10 2023-10-14T11:23:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.742+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00a9f0 con 0x7fdd74159c10 2023-10-14T11:23:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.742+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00ab50 con 0x7fdd74159c10 2023-10-14T11:23:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.742+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c011450 con 0x7fdd74159c10 2023-10-14T11:23:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.742+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd740c4100 con 0x7fdd74159c10 2023-10-14T11:23:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.742+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd740c46c0 con 0x7fdd74159c10 2023-10-14T11:23:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.743+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2dd406ce40 con 0x7f2dd415a8d0 2023-10-14T11:23:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.743+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2438973642 shutdown_connections 2023-10-14T11:23:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.743+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2438973642 wait complete. 2023-10-14T11:23:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.743+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd740c48e0 con 0x7fdd74159c10 2023-10-14T11:23:06.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.745+0000 7f77f7ff0700 1 Processor -- start 2023-10-14T11:23:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.746+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42680543f0 con 0x7f4278165f10 2023-10-14T11:23:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.747+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd6c0115b0 con 0x7fdd74159c10 2023-10-14T11:23:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.747+0000 7fdd69ffb700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 0x7fdd5806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7fdd797c6700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 0x7fdd5806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.747+0000 7f77f7ff0700 1 -- start start 2023-10-14T11:23:06.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 0x7f77f01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 0x7f77f0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f01626a0 con 0x7f77f0070a80 2023-10-14T11:23:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0163500 con 0x7f77f00c2740 2023-10-14T11:23:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f7ff0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00b1fc0 con 0x7f77f00c2b20 2023-10-14T11:23:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f5d8c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f5d8c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41640/0 (socket says 172.21.15.67:41640) 2023-10-14T11:23:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.748+0000 7f77f5d8c700 1 -- 172.21.15.67:0/2838517394 learned_addr learned my addr 172.21.15.67:0/2838517394 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f658d700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 0x7f77f0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 -- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 msgr2=0x7f77f0155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 0x7f77f0155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f558b700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 0x7f77f01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 -- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 msgr2=0x7f77f01555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 0x7f77f01555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 -- 172.21.15.67:0/2838517394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009550 con 0x7f77f0070a80 2023-10-14T11:23:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f658d700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 0x7f77f0155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f558b700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 0x7f77f01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7f77f5d8c700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00e810 tx=0x7f77ec00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7fdd797c6700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 0x7fdd5806d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400a950 tx=0x7fdd64009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.749+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd6c00d040 con 0x7fdd74159c10 2023-10-14T11:23:06.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.751+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec013610 con 0x7f77f0070a80 2023-10-14T11:23:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.751+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec013770 con 0x7f77f0070a80 2023-10-14T11:23:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.751+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec013b20 con 0x7f77f0070a80 2023-10-14T11:23:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.751+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f0162880 con 0x7f77f0070a80 2023-10-14T11:23:06.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.751+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f0162e40 con 0x7f77f0070a80 2023-10-14T11:23:06.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.752+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd6c08e060 con 0x7fdd74159c10 2023-10-14T11:23:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.755+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f77ec013c80 con 0x7f77f0070a80 2023-10-14T11:23:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.755+0000 7f77e67fc700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 0x7f77d406d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.755+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77ec089250 con 0x7f77f0070a80 2023-10-14T11:23:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.755+0000 7f77f558b700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 0x7f77d406d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.756+0000 7f77f558b700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 0x7f77d406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ccfb0 tx=0x7f77e0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.757+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d80052f0 con 0x7f77f0070a80 2023-10-14T11:23:06.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.766+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77ec054390 con 0x7f77f0070a80 2023-10-14T11:23:06.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.794+0000 7f385482a700 1 Processor -- start 2023-10-14T11:23:06.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.794+0000 7f385482a700 1 -- start start 2023-10-14T11:23:06.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.796+0000 7f385482a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f38500cc9a0 0x7f38500c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.796+0000 7f385482a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3850072520 0x7f3850159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.796+0000 7f385482a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385015d590 con 0x7f385006a810 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.796+0000 7f385482a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385015d870 con 0x7f38500cc9a0 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.796+0000 7f385482a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385015db50 con 0x7f3850072520 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.797+0000 7f384ed9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f385006a810 0x7f385006e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40948/0 (socket says 172.21.15.67:40948) 2023-10-14T11:23:06.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.797+0000 7f384ed9d700 1 -- 172.21.15.67:0/2241956476 learned_addr learned my addr 172.21.15.67:0/2241956476 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.797+0000 7f384dd9b700 1 --2- 172.21.15.67:0/2241956476 >> v2:172.21.15.72:3300/0 conn(0x7f3850072520 0x7f3850159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.797+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14803953 0 0) 0x7f385015d590 con 0x7f385006a810 2023-10-14T11:23:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38380035b0 con 0x7f385006a810 2023-10-14T11:23:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847564054 0 0) 0x7f38380035b0 con 0x7f385006a810 2023-10-14T11:23:06.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 >> v2:172.21.15.72:3300/0 conn(0x7f3850072520 msgr2=0x7f3850159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 --2- 172.21.15.67:0/2241956476 >> v2:172.21.15.72:3300/0 conn(0x7f3850072520 0x7f3850159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 >> v2:172.21.15.67:3300/0 conn(0x7f38500cc9a0 msgr2=0x7f38500c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 --2- 172.21.15.67:0/2241956476 >> v2:172.21.15.67:3300/0 conn(0x7f38500cc9a0 0x7f38500c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385015de30 con 0x7f385006a810 2023-10-14T11:23:06.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f3844001670 con 0x7f385006a810 2023-10-14T11:23:06.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 >> v1:172.21.15.67:6789/0 conn(0x7f385006a810 legacy=0x7f385006e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3838003a00 0x7f3838003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3838004850 0x7f3838004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f3838014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385015d870 con 0x7f3838005210 2023-10-14T11:23:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385015db50 con 0x7f3838003a00 2023-10-14T11:23:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.798+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38380149f0 con 0x7f3838004850 2023-10-14T11:23:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f3838014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 -- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3838004850 msgr2=0x7f3838004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T11:23:06.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3838004850 0x7f3838004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 -- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3838003a00 msgr2=0x7f3838003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T11:23:06.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3838003a00 0x7f3838003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 -- 172.21.15.67:0/2241956476 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385015de30 con 0x7f3838005210 2023-10-14T11:23:06.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.799+0000 7f384ed9d700 1 -- 172.21.15.67:0/2241956476 reap_dead start 2023-10-14T11:23:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.800+0000 7f384ed9d700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f3838014220 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f384400c2c0 tx=0x7f3838005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f833be1c3cfd5c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.800+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384400ce20 con 0x7f3838005210 2023-10-14T11:23:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.800+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3844005960 con 0x7f3838005210 2023-10-14T11:23:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.800+0000 7f384d59a700 1 -- 172.21.15.67:0/2241956476 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844005d10 con 0x7f3838005210 2023-10-14T11:23:06.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.801+0000 7f385482a700 1 -- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 msgr2=0x7f3838014220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.801+0000 7f385482a700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f3838014220 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f384400c2c0 tx=0x7f3838005880 comp rx=0 tx=0).stop 2023-10-14T11:23:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.802+0000 7f385482a700 1 -- 172.21.15.67:0/2241956476 shutdown_connections 2023-10-14T11:23:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.802+0000 7f385482a700 1 --2- 172.21.15.67:0/2241956476 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f3838014220 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.802+0000 7f385482a700 1 -- 172.21.15.67:0/2241956476 >> 172.21.15.67:0/2241956476 conn(0x7f38500cbeb0 msgr2=0x7f38500cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:06.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.802+0000 7f385482a700 1 -- 172.21.15.67:0/2241956476 shutdown_connections 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.802+0000 7f385482a700 1 -- 172.21.15.67:0/2241956476 wait complete. 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.804+0000 7f385482a700 1 Processor -- start 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.805+0000 7f385482a700 1 -- start start 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f38501f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 0x7f385014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 0x7f385015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38501ef400 con 0x7f3838005210 2023-10-14T11:23:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385014de60 con 0x7f385014a960 2023-10-14T11:23:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f385482a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38501ef660 con 0x7f38500c67a0 2023-10-14T11:23:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.806+0000 7f384dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 0x7f385014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.807+0000 7f384ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 0x7f385015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.808+0000 7f384dd9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 0x7f385014d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:43932/0 (socket says 172.21.15.67:43932) 2023-10-14T11:23:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.808+0000 7f384dd9b700 1 -- 172.21.15.67:0/1753950343 learned_addr learned my addr 172.21.15.67:0/1753950343 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:06.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.808+0000 7f384ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 0x7f385015c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42072/0 (socket says 172.21.15.67:42072) 2023-10-14T11:23:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.808+0000 7f384e59c700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f38501f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 -- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 msgr2=0x7f385014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 0x7f385014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 -- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 msgr2=0x7f385015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 0x7f385015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 -- 172.21.15.67:0/1753950343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38501ef940 con 0x7f3838005210 2023-10-14T11:23:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.809+0000 7f384e59c700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f38501f05d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3850069160 tx=0x7f3848009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.810+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800cad0 con 0x7f3838005210 2023-10-14T11:23:06.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.810+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384800cc30 con 0x7f3838005210 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.810+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848014440 con 0x7f3838005210 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.810+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38501efc20 con 0x7f3838005210 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.810+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38501f01e0 con 0x7f3838005210 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.814+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38480145a0 con 0x7f3838005210 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.815+0000 7f383effd700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 0x7f383807ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:06.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.815+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3848089180 con 0x7f3838005210 2023-10-14T11:23:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.816+0000 7f384dd9b700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 0x7f383807ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:06.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.816+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38340052f0 con 0x7f3838005210 2023-10-14T11:23:06.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.826+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f384805ce60 con 0x7f3838005210 2023-10-14T11:23:06.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:06.834+0000 7f384dd9b700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 0x7f383807ff00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38500aecf0 tx=0x7f3840008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.082 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.079+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efbd00055a0 con 0x7efbf006e410 2023-10-14T11:23:07.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.080+0000 7efbe5ffb700 1 -- 172.21.15.67:0/3726451953 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efbe002a020 con 0x7efbf006e410 2023-10-14T11:23:07.086 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2023-10-14T11:23:07.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 msgr2=0x7efbd406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 0x7efbd406d490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efbec006fd0 tx=0x7efbec008040 comp rx=0 tx=0).stop 2023-10-14T11:23:07.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 msgr2=0x7efbf00c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efbe0000c00 tx=0x7efbe0004750 comp rx=0 tx=0).stop 2023-10-14T11:23:07.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 shutdown_connections 2023-10-14T11:23:07.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf015bd60 0x7efbf01f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efbd406afd0 0x7efbd406d490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efbf006e410 0x7efbf00c43d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 --2- 172.21.15.67:0/3726451953 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efbf00cc9a0 0x7efbf00c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 >> 172.21.15.67:0/3726451953 conn(0x7efbf00cbeb0 msgr2=0x7efbf0158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 shutdown_connections 2023-10-14T11:23:07.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.084+0000 7efbf795f700 1 -- 172.21.15.67:0/3726451953 wait complete. 2023-10-14T11:23:07.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-14T11:23:07.106 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.103+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7eec005160 con 0x7f7f08161d90 2023-10-14T11:23:07.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.104+0000 7f7ef6ffd700 1 -- 172.21.15.67:0/1722814497 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7efc0092d0 con 0x7f7f08161d90 2023-10-14T11:23:07.110 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:07.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 msgr2=0x7f7ee806d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 0x7f7ee806d490 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009c40 tx=0x7f7ef8008030 comp rx=0 tx=0).stop 2023-10-14T11:23:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 msgr2=0x7f7f0815cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b550 tx=0x7f7efc00b910 comp rx=0 tx=0).stop 2023-10-14T11:23:07.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 shutdown_connections 2023-10-14T11:23:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7ee806afd0 0x7f7ee806d490 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009c40 tx=0x7f7ef8008030 comp rx=0 tx=0).stop 2023-10-14T11:23:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7f080c4e90 0x7f7f080c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7f080ca190 0x7f7f081f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 --2- 172.21.15.67:0/1722814497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7f08161d90 0x7f7f0815cbb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.108+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 >> 172.21.15.67:0/1722814497 conn(0x7f7f080cbeb0 msgr2=0x7f7f08161050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.111+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 shutdown_connections 2023-10-14T11:23:07.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.111+0000 7f7f0cfc0700 1 -- 172.21.15.67:0/1722814497 wait complete. 2023-10-14T11:23:07.130 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.127+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f63f015b570 con 0x7f63f00cd820 2023-10-14T11:23:07.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-14T11:23:07.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.129+0000 7f63d77fe700 1 -- 172.21.15.67:0/799524096 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63f015b570 con 0x7f63f00cd820 2023-10-14T11:23:07.132 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:07.132 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 msgr2=0x7f63dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 0x7f63dc06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63e4006fd0 tx=0x7f63e4006bc0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 msgr2=0x7f63f00b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c520 tx=0x7f63e000c8e0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 shutdown_connections 2023-10-14T11:23:07.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f63dc06af00 0x7f63dc06d3c0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f63e4006fd0 tx=0x7f63e4006bc0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f63f00cd820 0x7f63f00b0780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f63f006bb90 0x7f63f00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 --2- 172.21.15.67:0/799524096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63f00c3310 0x7f63f0157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.138 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.132+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 >> 172.21.15.67:0/799524096 conn(0x7f63f00b1740 msgr2=0x7f63f015bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.139 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.137+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 shutdown_connections 2023-10-14T11:23:07.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.137+0000 7f63f55f2700 1 -- 172.21.15.67:0/799524096 wait complete. 2023-10-14T11:23:07.144 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.141+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2dd406ce40 con 0x7f2dd415a8d0 2023-10-14T11:23:07.145 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.142+0000 7f2dcaffd700 1 -- 172.21.15.67:0/1825158025 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dd406ce40 con 0x7f2dd415a8d0 2023-10-14T11:23:07.145 INFO:teuthology.orchestra.run.smithi067.stdout:55834574855 2023-10-14T11:23:07.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.144+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 msgr2=0x7f2db806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.144+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 0x7f2db806d3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40b50f0 tx=0x7f2dd0008040 comp rx=0 tx=0).stop 2023-10-14T11:23:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.144+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 msgr2=0x7f2dd4150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.144+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00b730 tx=0x7f2dcc004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 shutdown_connections 2023-10-14T11:23:07.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2dd415a8d0 0x7f2dd4150600 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2dd40b1250 0x7f2dd4153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2db806af00 0x7f2db806d3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 --2- 172.21.15.67:0/1825158025 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2dd40caeb0 0x7f2dd40b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.145+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 >> 172.21.15.67:0/1825158025 conn(0x7f2dd40cc250 msgr2=0x7f2dd4070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.149+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 shutdown_connections 2023-10-14T11:23:07.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.149+0000 7f2ddc669700 1 -- 172.21.15.67:0/1825158025 wait complete. 2023-10-14T11:23:07.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-10-14T11:23:07.159 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-14T11:23:07.165 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.168+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f77d8005870 con 0x7f77f0070a80 2023-10-14T11:23:07.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.168+0000 7f77e67fc700 1 -- 172.21.15.67:0/2838517394 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77ec021090 con 0x7f77f0070a80 2023-10-14T11:23:07.171 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:07.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 msgr2=0x7f77d406d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 0x7f77d406d410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77f00ccfb0 tx=0x7f77e0008030 comp rx=0 tx=0).stop 2023-10-14T11:23:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 msgr2=0x7f77f00c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00e810 tx=0x7f77ec00ebd0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 shutdown_connections 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f77f00c2b20 0x7f77f0155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f77d406af50 0x7f77d406d410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f77f0070a80 0x7f77f00c8780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 --2- 172.21.15.67:0/2838517394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f77f00c2740 0x7f77f01555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 >> 172.21.15.67:0/2838517394 conn(0x7f77f00cbeb0 msgr2=0x7f77f0160fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.170+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 shutdown_connections 2023-10-14T11:23:07.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.171+0000 7f77f7ff0700 1 -- 172.21.15.67:0/2838517394 wait complete. 2023-10-14T11:23:07.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.176+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3834005870 con 0x7f3838005210 2023-10-14T11:23:07.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.177+0000 7f383effd700 1 -- 172.21.15.67:0/1753950343 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3848019070 con 0x7f3838005210 2023-10-14T11:23:07.180 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.178+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd74070980 con 0x7fdd74159c10 2023-10-14T11:23:07.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.178+0000 7fdd69ffb700 1 -- 172.21.15.67:0/2078475750 <== mon.1 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd6c015090 con 0x7fdd74159c10 2023-10-14T11:23:07.182 INFO:teuthology.orchestra.run.smithi067.stdout:55834574853 2023-10-14T11:23:07.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f427806a810 con 0x7f4278165f10 2023-10-14T11:23:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 msgr2=0x7f383807ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 0x7f383807ff00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38500aecf0 tx=0x7f3840008040 comp rx=0 tx=0).stop 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 msgr2=0x7f38501f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f38501f05d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3850069160 tx=0x7f3848009ed0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 shutdown_connections 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f385014a960 0x7f385015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f383807da40 0x7f383807ff00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3838005210 0x7f38501f05d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 --2- 172.21.15.67:0/1753950343 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f38500c67a0 0x7f385014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 >> 172.21.15.67:0/1753950343 conn(0x7f38500cbeb0 msgr2=0x7f38500cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 shutdown_connections 2023-10-14T11:23:07.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f385482a700 1 -- 172.21.15.67:0/1753950343 wait complete. 2023-10-14T11:23:07.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.179+0000 7f4274ff9700 1 -- 172.21.15.67:0/2356231057 <== mon.2 v2:172.21.15.72:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4268015070 con 0x7f4278165f10 2023-10-14T11:23:07.186 INFO:teuthology.orchestra.run.smithi067.stdout:55834574854 2023-10-14T11:23:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 msgr2=0x7f426406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 0x7f426406d3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f427000b370 tx=0x7f4270011000 comp rx=0 tx=0).stop 2023-10-14T11:23:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 msgr2=0x7f42780ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 0x7f42780ce4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f426800b3e0 tx=0x7f426800b6f0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 msgr2=0x7fdd5806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 0x7fdd5806d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400a950 tx=0x7fdd64009030 comp rx=0 tx=0).stop 2023-10-14T11:23:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 msgr2=0x7fdd7415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00cb70 tx=0x7fdd6c00ce80 comp rx=0 tx=0).stop 2023-10-14T11:23:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 shutdown_connections 2023-10-14T11:23:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4278165f10 0x7f42780ce4a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f426406af00 0x7f426406d3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f427806af20 0x7f42782001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 --2- 172.21.15.67:0/2356231057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4278161e90 0x7f4278204750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 shutdown_connections 2023-10-14T11:23:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 >> 172.21.15.67:0/2356231057 conn(0x7f42780b0f60 msgr2=0x7f4278070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd74159c10 0x7fdd7415bc00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd74072520 0x7fdd741ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdd5806af20 0x7fdd5806d3e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 --2- 172.21.15.67:0/2078475750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdd74159830 0x7fdd7415b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 >> 172.21.15.67:0/2078475750 conn(0x7fdd740cbeb0 msgr2=0x7fdd74158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 shutdown_connections 2023-10-14T11:23:07.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7f427e6a8700 1 -- 172.21.15.67:0/2356231057 wait complete. 2023-10-14T11:23:07.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 shutdown_connections 2023-10-14T11:23:07.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.182+0000 7fdd7ba2a700 1 -- 172.21.15.67:0/2078475750 wait complete. 2023-10-14T11:23:07.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-14T11:23:07.196 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-14T11:23:07.198 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-14T11:23:07.207 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-14T11:23:07.208 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:07.208 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T11:23:07.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:07.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.368+0000 7f1098813700 1 Processor -- start 2023-10-14T11:23:07.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.368+0000 7f1098813700 1 -- start start 2023-10-14T11:23:07.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.369+0000 7f1098813700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f109415ba20 0x7f1094072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.369+0000 7f1098813700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109406b700 con 0x7f109406af20 2023-10-14T11:23:07.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.369+0000 7f1098813700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109406b420 con 0x7f10940cc260 2023-10-14T11:23:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.369+0000 7f1098813700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10940d1310 con 0x7f109415ba20 2023-10-14T11:23:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109259c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f109415ba20 0x7f1094072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f1092d9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f109406af20 0x7f10940caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40966/0 (socket says 172.21.15.67:40966) 2023-10-14T11:23:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f1092d9d700 1 -- 172.21.15.67:0/2761302121 learned_addr learned my addr 172.21.15.67:0/2761302121 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:07.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109259c700 1 -- 172.21.15.67:0/2761302121 >> v1:172.21.15.72:6789/0 conn(0x7f10940cc260 legacy=0x7f109406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109259c700 1 -- 172.21.15.67:0/2761302121 >> v1:172.21.15.67:6789/0 conn(0x7f109406af20 legacy=0x7f10940caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109259c700 1 -- 172.21.15.67:0/2761302121 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094071c80 con 0x7f109415ba20 2023-10-14T11:23:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109159a700 1 -- 172.21.15.67:0/2761302121 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710166536 0 0) 0x7f109406b700 con 0x7f109406af20 2023-10-14T11:23:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109259c700 1 --2- 172.21.15.67:0/2761302121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109415ba20 0x7f1094072760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1084009840 tx=0x7f1084009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f878e38bb00475 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109159a700 1 -- 172.21.15.67:0/2761302121 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084011830 con 0x7f109415ba20 2023-10-14T11:23:07.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109159a700 1 -- 172.21.15.67:0/2761302121 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084011990 con 0x7f109415ba20 2023-10-14T11:23:07.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.370+0000 7f109159a700 1 -- 172.21.15.67:0/2761302121 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084011d20 con 0x7f109415ba20 2023-10-14T11:23:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 -- 172.21.15.67:0/2761302121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109415ba20 msgr2=0x7f1094072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 --2- 172.21.15.67:0/2761302121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109415ba20 0x7f1094072760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1084009840 tx=0x7f1084009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:07.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 -- 172.21.15.67:0/2761302121 shutdown_connections 2023-10-14T11:23:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 --2- 172.21.15.67:0/2761302121 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f109415ba20 0x7f1094072760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 -- 172.21.15.67:0/2761302121 >> 172.21.15.67:0/2761302121 conn(0x7f10940d0440 msgr2=0x7f10940d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 -- 172.21.15.67:0/2761302121 shutdown_connections 2023-10-14T11:23:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.371+0000 7f1098813700 1 -- 172.21.15.67:0/2761302121 wait complete. 2023-10-14T11:23:07.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.372+0000 7f1098813700 1 Processor -- start 2023-10-14T11:23:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.372+0000 7f1098813700 1 -- start start 2023-10-14T11:23:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109406af20 0x7f10941f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109415ba20 0x7f10940ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940af200 con 0x7f10940cc260 2023-10-14T11:23:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10940aef20 con 0x7f109415ba20 2023-10-14T11:23:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1098813700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10941f6810 con 0x7f109406af20 2023-10-14T11:23:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41676/0 (socket says 172.21.15.67:41676) 2023-10-14T11:23:07.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 -- 172.21.15.67:0/3230620902 learned_addr learned my addr 172.21.15.67:0/3230620902 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:07.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f109259c700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109406af20 0x7f10941f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1092d9d700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109415ba20 0x7f10940ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 -- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109406af20 msgr2=0x7f10941f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109406af20 0x7f10941f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 -- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109415ba20 msgr2=0x7f10940ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109415ba20 0x7f10940ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.373+0000 7f1091d9b700 1 -- 172.21.15.67:0/3230620902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840094a0 con 0x7f10940cc260 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1091d9b700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f108800c4e0 tx=0x7f108800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880052d0 con 0x7f10940cc260 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088005430 con 0x7f10940cc260 2023-10-14T11:23:07.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880038c0 con 0x7f10940cc260 2023-10-14T11:23:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10941f6af0 con 0x7f10940cc260 2023-10-14T11:23:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.374+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940aea80 con 0x7f10940cc260 2023-10-14T11:23:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.375+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109404ebb0 con 0x7f10940cc260 2023-10-14T11:23:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.375+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1088003a20 con 0x7f10940cc260 2023-10-14T11:23:07.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.376+0000 7f1082ffd700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 0x7f107406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.376+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1088088960 con 0x7f10940cc260 2023-10-14T11:23:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.376+0000 7f109259c700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 0x7f107406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.376+0000 7f109259c700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 0x7f107406d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10840090b0 tx=0x7f108401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.380+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1088053a10 con 0x7f10940cc260 2023-10-14T11:23:07.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.576+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1094072240 con 0x7f107406af00 2023-10-14T11:23:07.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.584+0000 7f1082ffd700 1 -- 172.21.15.67:0/3230620902 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264548 (secure 0 0 0) 0x7f1084011c30 con 0x7f107406af00 2023-10-14T11:23:07.590 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:07.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.587+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 msgr2=0x7f107406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.587+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 0x7f107406d3c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10840090b0 tx=0x7f108401c040 comp rx=0 tx=0).stop 2023-10-14T11:23:07.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 msgr2=0x7f10941534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f108800c4e0 tx=0x7f108800c7f0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 shutdown_connections 2023-10-14T11:23:07.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f109415ba20 0x7f10940ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f109406af20 0x7f10941f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f107406af00 0x7f107406d3c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 --2- 172.21.15.67:0/3230620902 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f10940cc260 0x7f10941534f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 >> 172.21.15.67:0/3230620902 conn(0x7f10940d0440 msgr2=0x7f1094158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 shutdown_connections 2023-10-14T11:23:07.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.588+0000 7f1098813700 1 -- 172.21.15.67:0/3230620902 wait complete. 2023-10-14T11:23:07.595 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:07.603 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T11:23:06.402310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427431+0000","last_change":"2023-10-14T11:22:58.633786+0000","last_active":"2023-10-14T11:23:00.427431+0000","last_peered":"2023-10-14T11:23:00.427431+0000","last_clean":"2023-10-14T11:23:00.427431+0000","last_became_active":"2023-10-14T11:22:58.633501+0000","last_became_peered":"2023-10-14T11:22:58.633501+0000","last_unstale":"2023-10-14T11:23:00.427431+0000","last_undegraded":"2023-10-14T11:23:00.427431+0000","last_fullsized":"2023-10-14T11:23:00.427431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:23.198990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618109+0000","last_change":"2023-10-14T11:22:58.622868+0000","last_active":"2023-10-14T11:22:59.618109+0000","last_peered":"2023-10-14T11:22:59.618109+0000","last_clean":"2023-10-14T11:22:59.618109+0000","last_became_active":"2023-10-14T11:22:58.622234+0000","last_became_peered":"2023-10-14T11:22:58.622234+0000","last_unstale":"2023-10-14T11:22:59.618109+0000","last_undegraded":"2023-10-14T11:22:59.618109+0000","last_fullsized":"2023-10-14T11:22:59.618109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203623+0000","last_change":"2023-10-14T11:22:58.624332+0000","last_active":"2023-10-14T11:23:00.203623+0000","last_peered":"2023-10-14T11:23:00.203623+0000","last_clean":"2023-10-14T11:23:00.203623+0000","last_became_active":"2023-10-14T11:22:58.623983+0000","last_became_peered":"2023-10-14T11:22:58.623983+0000","last_unstale":"2023-10-14T11:23:00.203623+0000","last_undegraded":"2023-10-14T11:23:00.203623+0000","last_fullsized":"2023-10-14T11:23:00.203623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618466+0000","last_change":"2023-10-14T11:22:58.633546+0000","last_active":"2023-10-14T11:22:59.618466+0000","last_peered":"2023-10-14T11:22:59.618466+0000","last_clean":"2023-10-14T11:22:59.618466+0000","last_became_active":"2023-10-14T11:22:58.632591+0000","last_became_peered":"2023-10-14T11:22:58.632591+0000","last_unstale":"2023-10-14T11:22:59.618466+0000","last_undegraded":"2023-10-14T11:22:59.618466+0000","last_fullsized":"2023-10-14T11:22:59.618466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427014+0000","last_change":"2023-10-14T11:22:58.625368+0000","last_active":"2023-10-14T11:23:00.427014+0000","last_peered":"2023-10-14T11:23:00.427014+0000","last_clean":"2023-10-14T11:23:00.427014+0000","last_became_active":"2023-10-14T11:22:58.622784+0000","last_became_peered":"2023-10-14T11:22:58.622784+0000","last_unstale":"2023-10-14T11:23:00.427014+0000","last_undegraded":"2023-10-14T11:23:00.427014+0000","last_fullsized":"2023-10-14T11:23:00.427014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617901+0000","last_change":"2023-10-14T11:22:58.639055+0000","last_active":"2023-10-14T11:22:59.617901+0000","last_peered":"2023-10-14T11:22:59.617901+0000","last_clean":"2023-10-14T11:22:59.617901+0000","last_became_active":"2023-10-14T11:22:58.638778+0000","last_became_peered":"2023-10-14T11:22:58.638778+0000","last_unstale":"2023-10-14T11:22:59.617901+0000","last_undegraded":"2023-10-14T11:22:59.617901+0000","last_fullsized":"2023-10-14T11:22:59.617901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426896+0000","last_change":"2023-10-14T11:22:58.627430+0000","last_active":"2023-10-14T11:23:00.426896+0000","last_peered":"2023-10-14T11:23:00.426896+0000","last_clean":"2023-10-14T11:23:00.426896+0000","last_became_active":"2023-10-14T11:22:58.621813+0000","last_became_peered":"2023-10-14T11:22:58.621813+0000","last_unstale":"2023-10-14T11:23:00.426896+0000","last_undegraded":"2023-10-14T11:23:00.426896+0000","last_fullsized":"2023-10-14T11:23:00.426896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426617+0000","last_change":"2023-10-14T11:22:58.634733+0000","last_active":"2023-10-14T11:23:00.426617+0000","last_peered":"2023-10-14T11:23:00.426617+0000","last_clean":"2023-10-14T11:23:00.426617+0000","last_became_active":"2023-10-14T11:22:58.634207+0000","last_became_peered":"2023-10-14T11:22:58.634207+0000","last_unstale":"2023-10-14T11:23:00.426617+0000","last_undegraded":"2023-10-14T11:23:00.426617+0000","last_fullsized":"2023-10-14T11:23:00.426617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427274+0000","last_change":"2023-10-14T11:22:58.637875+0000","last_active":"2023-10-14T11:23:00.427274+0000","last_peered":"2023-10-14T11:23:00.427274+0000","last_clean":"2023-10-14T11:23:00.427274+0000","last_became_active":"2023-10-14T11:22:58.637706+0000","last_became_peered":"2023-10-14T11:22:58.637706+0000","last_unstale":"2023-10-14T11:23:00.427274+0000","last_undegraded":"2023-10-14T11:23:00.427274+0000","last_fullsized":"2023-10-14T11:23:00.427274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:02:14.102087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619647+0000","last_change":"2023-10-14T11:22:58.632598+0000","last_active":"2023-10-14T11:22:59.619647+0000","last_peered":"2023-10-14T11:22:59.619647+0000","last_clean":"2023-10-14T11:22:59.619647+0000","last_became_active":"2023-10-14T11:22:58.632159+0000","last_became_peered":"2023-10-14T11:22:58.632159+0000","last_unstale":"2023-10-14T11:22:59.619647+0000","last_undegraded":"2023-10-14T11:22:59.619647+0000","last_fullsized":"2023-10-14T11:22:59.619647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619162+0000","last_change":"2023-10-14T11:22:58.635248+0000","last_active":"2023-10-14T11:22:59.619162+0000","last_peered":"2023-10-14T11:22:59.619162+0000","last_clean":"2023-10-14T11:22:59.619162+0000","last_became_active":"2023-10-14T11:22:58.634992+0000","last_became_peered":"2023-10-14T11:22:58.634992+0000","last_unstale":"2023-10-14T11:22:59.619162+0000","last_undegraded":"2023-10-14T11:22:59.619162+0000","last_fullsized":"2023-10-14T11:22:59.619162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919307+0000","last_change":"2023-10-14T11:22:58.624511+0000","last_active":"2023-10-14T11:22:59.919307+0000","last_peered":"2023-10-14T11:22:59.919307+0000","last_clean":"2023-10-14T11:22:59.919307+0000","last_became_active":"2023-10-14T11:22:58.623795+0000","last_became_peered":"2023-10-14T11:22:58.623795+0000","last_unstale":"2023-10-14T11:22:59.919307+0000","last_undegraded":"2023-10-14T11:22:59.919307+0000","last_fullsized":"2023-10-14T11:22:59.919307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:00.651862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427131+0000","last_change":"2023-10-14T11:22:58.620085+0000","last_active":"2023-10-14T11:23:00.427131+0000","last_peered":"2023-10-14T11:23:00.427131+0000","last_clean":"2023-10-14T11:23:00.427131+0000","last_became_active":"2023-10-14T11:22:58.619466+0000","last_became_peered":"2023-10-14T11:22:58.619466+0000","last_unstale":"2023-10-14T11:23:00.427131+0000","last_undegraded":"2023-10-14T11:23:00.427131+0000","last_fullsized":"2023-10-14T11:23:00.427131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203570+0000","last_change":"2023-10-14T11:22:58.618541+0000","last_active":"2023-10-14T11:23:00.203570+0000","last_peered":"2023-10-14T11:23:00.203570+0000","last_clean":"2023-10-14T11:23:00.203570+0000","last_became_active":"2023-10-14T11:22:58.618206+0000","last_became_peered":"2023-10-14T11:22:58.618206+0000","last_unstale":"2023-10-14T11:23:00.203570+0000","last_undegraded":"2023-10-14T11:23:00.203570+0000","last_fullsized":"2023-10-14T11:23:00.203570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617739+0000","last_change":"2023-10-14T11:22:58.625071+0000","last_active":"2023-10-14T11:22:59.617739+0000","last_peered":"2023-10-14T11:22:59.617739+0000","last_clean":"2023-10-14T11:22:59.617739+0000","last_became_active":"2023-10-14T11:22:58.624786+0000","last_became_peered":"2023-10-14T11:22:58.624786+0000","last_unstale":"2023-10-14T11:22:59.617739+0000","last_undegraded":"2023-10-14T11:22:59.617739+0000","last_fullsized":"2023-10-14T11:22:59.617739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617746+0000","last_change":"2023-10-14T11:22:58.632587+0000","last_active":"2023-10-14T11:22:59.617746+0000","last_peered":"2023-10-14T11:22:59.617746+0000","last_clean":"2023-10-14T11:22:59.617746+0000","last_became_active":"2023-10-14T11:22:58.631338+0000","last_became_peered":"2023-10-14T11:22:58.631338+0000","last_unstale":"2023-10-14T11:22:59.617746+0000","last_undegraded":"2023-10-14T11:22:59.617746+0000","last_fullsized":"2023-10-14T11:22:59.617746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618293+0000","last_change":"2023-10-14T11:22:58.637286+0000","last_active":"2023-10-14T11:22:59.618293+0000","last_peered":"2023-10-14T11:22:59.618293+0000","last_clean":"2023-10-14T11:22:59.618293+0000","last_became_active":"2023-10-14T11:22:58.636987+0000","last_became_peered":"2023-10-14T11:22:58.636987+0000","last_unstale":"2023-10-14T11:22:59.618293+0000","last_undegraded":"2023-10-14T11:22:59.618293+0000","last_fullsized":"2023-10-14T11:22:59.618293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427284+0000","last_change":"2023-10-14T11:22:58.627520+0000","last_active":"2023-10-14T11:23:00.427284+0000","last_peered":"2023-10-14T11:23:00.427284+0000","last_clean":"2023-10-14T11:23:00.427284+0000","last_became_active":"2023-10-14T11:22:58.627210+0000","last_became_peered":"2023-10-14T11:22:58.627210+0000","last_unstale":"2023-10-14T11:23:00.427284+0000","last_undegraded":"2023-10-14T11:23:00.427284+0000","last_fullsized":"2023-10-14T11:23:00.427284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427097+0000","last_change":"2023-10-14T11:22:58.625306+0000","last_active":"2023-10-14T11:23:00.427097+0000","last_peered":"2023-10-14T11:23:00.427097+0000","last_clean":"2023-10-14T11:23:00.427097+0000","last_became_active":"2023-10-14T11:22:58.625026+0000","last_became_peered":"2023-10-14T11:22:58.625026+0000","last_unstale":"2023-10-14T11:23:00.427097+0000","last_undegraded":"2023-10-14T11:23:00.427097+0000","last_fullsized":"2023-10-14T11:23:00.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203594+0000","last_change":"2023-10-14T11:22:57.606379+0000","last_active":"2023-10-14T11:23:00.203594+0000","last_peered":"2023-10-14T11:23:00.203594+0000","last_clean":"2023-10-14T11:23:00.203594+0000","last_became_active":"2023-10-14T11:22:57.606084+0000","last_became_peered":"2023-10-14T11:22:57.606084+0000","last_unstale":"2023-10-14T11:23:00.203594+0000","last_undegraded":"2023-10-14T11:23:00.203594+0000","last_fullsized":"2023-10-14T11:23:00.203594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:46.618392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427389+0000","last_change":"2023-10-14T11:22:58.617985+0000","last_active":"2023-10-14T11:23:00.427389+0000","last_peered":"2023-10-14T11:23:00.427389+0000","last_clean":"2023-10-14T11:23:00.427389+0000","last_became_active":"2023-10-14T11:22:58.617671+0000","last_became_peered":"2023-10-14T11:22:58.617671+0000","last_unstale":"2023-10-14T11:23:00.427389+0000","last_undegraded":"2023-10-14T11:23:00.427389+0000","last_fullsized":"2023-10-14T11:23:00.427389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427061+0000","last_change":"2023-10-14T11:22:57.606838+0000","last_active":"2023-10-14T11:23:00.427061+0000","last_peered":"2023-10-14T11:23:00.427061+0000","last_clean":"2023-10-14T11:23:00.427061+0000","last_became_active":"2023-10-14T11:22:57.606525+0000","last_became_peered":"2023-10-14T11:22:57.606525+0000","last_unstale":"2023-10-14T11:23:00.427061+0000","last_undegraded":"2023-10-14T11:23:00.427061+0000","last_fullsized":"2023-10-14T11:23:00.427061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203773+0000","last_change":"2023-10-14T11:22:58.635376+0000","last_active":"2023-10-14T11:23:00.203773+0000","last_peered":"2023-10-14T11:23:00.203773+0000","last_clean":"2023-10-14T11:23:00.203773+0000","last_became_active":"2023-10-14T11:22:58.635055+0000","last_became_peered":"2023-10-14T11:22:58.635055+0000","last_unstale":"2023-10-14T11:23:00.203773+0000","last_undegraded":"2023-10-14T11:23:00.203773+0000","last_fullsized":"2023-10-14T11:23:00.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427311+0000","last_change":"2023-10-14T11:22:57.606462+0000","last_active":"2023-10-14T11:23:00.427311+0000","last_peered":"2023-10-14T11:23:00.427311+0000","last_clean":"2023-10-14T11:23:00.427311+0000","last_became_active":"2023-10-14T11:22:57.606205+0000","last_became_peered":"2023-10-14T11:22:57.606205+0000","last_unstale":"2023-10-14T11:23:00.427311+0000","last_undegraded":"2023-10-14T11:23:00.427311+0000","last_fullsized":"2023-10-14T11:23:00.427311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619693+0000","last_change":"2023-10-14T11:22:58.634078+0000","last_active":"2023-10-14T11:22:59.619693+0000","last_peered":"2023-10-14T11:22:59.619693+0000","last_clean":"2023-10-14T11:22:59.619693+0000","last_became_active":"2023-10-14T11:22:58.633808+0000","last_became_peered":"2023-10-14T11:22:58.633808+0000","last_unstale":"2023-10-14T11:22:59.619693+0000","last_undegraded":"2023-10-14T11:22:59.619693+0000","last_fullsized":"2023-10-14T11:22:59.619693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426936+0000","last_change":"2023-10-14T11:22:57.608295+0000","last_active":"2023-10-14T11:23:00.426936+0000","last_peered":"2023-10-14T11:23:00.426936+0000","last_clean":"2023-10-14T11:23:00.426936+0000","last_became_active":"2023-10-14T11:22:57.607972+0000","last_became_peered":"2023-10-14T11:22:57.607972+0000","last_unstale":"2023-10-14T11:23:00.426936+0000","last_undegraded":"2023-10-14T11:23:00.426936+0000","last_fullsized":"2023-10-14T11:23:00.426936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:33.504370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618196+0000","last_change":"2023-10-14T11:22:58.633471+0000","last_active":"2023-10-14T11:22:59.618196+0000","last_peered":"2023-10-14T11:22:59.618196+0000","last_clean":"2023-10-14T11:22:59.618196+0000","last_became_active":"2023-10-14T11:22:58.633175+0000","last_became_peered":"2023-10-14T11:22:58.633175+0000","last_unstale":"2023-10-14T11:22:59.618196+0000","last_undegraded":"2023-10-14T11:22:59.618196+0000","last_fullsized":"2023-10-14T11:22:59.618196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427053+0000","last_change":"2023-10-14T11:22:57.608273+0000","last_active":"2023-10-14T11:23:00.427053+0000","last_peered":"2023-10-14T11:23:00.427053+0000","last_clean":"2023-10-14T11:23:00.427053+0000","last_became_active":"2023-10-14T11:22:57.607043+0000","last_became_peered":"2023-10-14T11:22:57.607043+0000","last_unstale":"2023-10-14T11:23:00.427053+0000","last_undegraded":"2023-10-14T11:23:00.427053+0000","last_fullsized":"2023-10-14T11:23:00.427053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918907+0000","last_change":"2023-10-14T11:22:58.618099+0000","last_active":"2023-10-14T11:22:59.918907+0000","last_peered":"2023-10-14T11:22:59.918907+0000","last_clean":"2023-10-14T11:22:59.918907+0000","last_became_active":"2023-10-14T11:22:58.617688+0000","last_became_peered":"2023-10-14T11:22:58.617688+0000","last_unstale":"2023-10-14T11:22:59.918907+0000","last_undegraded":"2023-10-14T11:22:59.918907+0000","last_fullsized":"2023-10-14T11:22:59.918907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:15.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619036+0000","last_change":"2023-10-14T11:22:57.596557+0000","last_active":"2023-10-14T11:22:59.619036+0000","last_peered":"2023-10-14T11:22:59.619036+0000","last_clean":"2023-10-14T11:22:59.619036+0000","last_became_active":"2023-10-14T11:22:57.596258+0000","last_became_peered":"2023-10-14T11:22:57.596258+0000","last_unstale":"2023-10-14T11:22:59.619036+0000","last_undegraded":"2023-10-14T11:22:59.619036+0000","last_fullsized":"2023-10-14T11:22:59.619036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203763+0000","last_change":"2023-10-14T11:22:58.624416+0000","last_active":"2023-10-14T11:23:00.203763+0000","last_peered":"2023-10-14T11:23:00.203763+0000","last_clean":"2023-10-14T11:23:00.203763+0000","last_became_active":"2023-10-14T11:22:58.624136+0000","last_became_peered":"2023-10-14T11:22:58.624136+0000","last_unstale":"2023-10-14T11:23:00.203763+0000","last_undegraded":"2023-10-14T11:23:00.203763+0000","last_fullsized":"2023-10-14T11:23:00.203763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426746+0000","last_change":"2023-10-14T11:22:57.607548+0000","last_active":"2023-10-14T11:23:00.426746+0000","last_peered":"2023-10-14T11:23:00.426746+0000","last_clean":"2023-10-14T11:23:00.426746+0000","last_became_active":"2023-10-14T11:22:57.607266+0000","last_became_peered":"2023-10-14T11:22:57.607266+0000","last_unstale":"2023-10-14T11:23:00.426746+0000","last_undegraded":"2023-10-14T11:23:00.426746+0000","last_fullsized":"2023-10-14T11:23:00.426746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427490+0000","last_change":"2023-10-14T11:22:58.627962+0000","last_active":"2023-10-14T11:23:00.427490+0000","last_peered":"2023-10-14T11:23:00.427490+0000","last_clean":"2023-10-14T11:23:00.427490+0000","last_became_active":"2023-10-14T11:22:58.627647+0000","last_became_peered":"2023-10-14T11:22:58.627647+0000","last_unstale":"2023-10-14T11:23:00.427490+0000","last_undegraded":"2023-10-14T11:23:00.427490+0000","last_fullsized":"2023-10-14T11:23:00.427490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618403+0000","last_change":"2023-10-14T11:22:57.601447+0000","last_active":"2023-10-14T11:22:59.618403+0000","last_peered":"2023-10-14T11:22:59.618403+0000","last_clean":"2023-10-14T11:22:59.618403+0000","last_became_active":"2023-10-14T11:22:57.601160+0000","last_became_peered":"2023-10-14T11:22:57.601160+0000","last_unstale":"2023-10-14T11:22:59.618403+0000","last_undegraded":"2023-10-14T11:22:59.618403+0000","last_fullsized":"2023-10-14T11:22:59.618403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617889+0000","last_change":"2023-10-14T11:22:58.619189+0000","last_active":"2023-10-14T11:22:59.617889+0000","last_peered":"2023-10-14T11:22:59.617889+0000","last_clean":"2023-10-14T11:22:59.617889+0000","last_became_active":"2023-10-14T11:22:58.618873+0000","last_became_peered":"2023-10-14T11:22:58.618873+0000","last_unstale":"2023-10-14T11:22:59.617889+0000","last_undegraded":"2023-10-14T11:22:59.617889+0000","last_fullsized":"2023-10-14T11:22:59.617889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619790+0000","last_change":"2023-10-14T11:22:57.601166+0000","last_active":"2023-10-14T11:22:59.619790+0000","last_peered":"2023-10-14T11:22:59.619790+0000","last_clean":"2023-10-14T11:22:59.619790+0000","last_became_active":"2023-10-14T11:22:57.600664+0000","last_became_peered":"2023-10-14T11:22:57.600664+0000","last_unstale":"2023-10-14T11:22:59.619790+0000","last_undegraded":"2023-10-14T11:22:59.619790+0000","last_fullsized":"2023-10-14T11:22:59.619790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618932+0000","last_change":"2023-10-14T11:22:58.638814+0000","last_active":"2023-10-14T11:22:59.618932+0000","last_peered":"2023-10-14T11:22:59.618932+0000","last_clean":"2023-10-14T11:22:59.618932+0000","last_became_active":"2023-10-14T11:22:58.638511+0000","last_became_peered":"2023-10-14T11:22:58.638511+0000","last_unstale":"2023-10-14T11:22:59.618932+0000","last_undegraded":"2023-10-14T11:22:59.618932+0000","last_fullsized":"2023-10-14T11:22:59.618932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618785+0000","last_change":"2023-10-14T11:22:57.605185+0000","last_active":"2023-10-14T11:22:59.618785+0000","last_peered":"2023-10-14T11:22:59.618785+0000","last_clean":"2023-10-14T11:22:59.618785+0000","last_became_active":"2023-10-14T11:22:57.604882+0000","last_became_peered":"2023-10-14T11:22:57.604882+0000","last_unstale":"2023-10-14T11:22:59.618785+0000","last_undegraded":"2023-10-14T11:22:59.618785+0000","last_fullsized":"2023-10-14T11:22:59.618785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:09.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203726+0000","last_change":"2023-10-14T11:22:58.635766+0000","last_active":"2023-10-14T11:23:00.203726+0000","last_peered":"2023-10-14T11:23:00.203726+0000","last_clean":"2023-10-14T11:23:00.203726+0000","last_became_active":"2023-10-14T11:22:58.635066+0000","last_became_peered":"2023-10-14T11:22:58.635066+0000","last_unstale":"2023-10-14T11:23:00.203726+0000","last_undegraded":"2023-10-14T11:23:00.203726+0000","last_fullsized":"2023-10-14T11:23:00.203726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617960+0000","last_change":"2023-10-14T11:22:57.604629+0000","last_active":"2023-10-14T11:22:59.617960+0000","last_peered":"2023-10-14T11:22:59.617960+0000","last_clean":"2023-10-14T11:22:59.617960+0000","last_became_active":"2023-10-14T11:22:57.604227+0000","last_became_peered":"2023-10-14T11:22:57.604227+0000","last_unstale":"2023-10-14T11:22:59.617960+0000","last_undegraded":"2023-10-14T11:22:59.617960+0000","last_fullsized":"2023-10-14T11:22:59.617960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919288+0000","last_change":"2023-10-14T11:22:58.624704+0000","last_active":"2023-10-14T11:22:59.919288+0000","last_peered":"2023-10-14T11:22:59.919288+0000","last_clean":"2023-10-14T11:22:59.919288+0000","last_became_active":"2023-10-14T11:22:58.624178+0000","last_became_peered":"2023-10-14T11:22:58.624178+0000","last_unstale":"2023-10-14T11:22:59.919288+0000","last_undegraded":"2023-10-14T11:22:59.919288+0000","last_fullsized":"2023-10-14T11:22:59.919288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619299+0000","last_change":"2023-10-14T11:22:57.611378+0000","last_active":"2023-10-14T11:22:59.619299+0000","last_peered":"2023-10-14T11:22:59.619299+0000","last_clean":"2023-10-14T11:22:59.619299+0000","last_became_active":"2023-10-14T11:22:57.611089+0000","last_became_peered":"2023-10-14T11:22:57.611089+0000","last_unstale":"2023-10-14T11:22:59.619299+0000","last_undegraded":"2023-10-14T11:22:59.619299+0000","last_fullsized":"2023-10-14T11:22:59.619299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427075+0000","last_change":"2023-10-14T11:22:58.625644+0000","last_active":"2023-10-14T11:23:00.427075+0000","last_peered":"2023-10-14T11:23:00.427075+0000","last_clean":"2023-10-14T11:23:00.427075+0000","last_became_active":"2023-10-14T11:22:58.621672+0000","last_became_peered":"2023-10-14T11:22:58.621672+0000","last_unstale":"2023-10-14T11:23:00.427075+0000","last_undegraded":"2023-10-14T11:23:00.427075+0000","last_fullsized":"2023-10-14T11:23:00.427075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203761+0000","last_change":"2023-10-14T11:22:57.595554+0000","last_active":"2023-10-14T11:23:00.203761+0000","last_peered":"2023-10-14T11:23:00.203761+0000","last_clean":"2023-10-14T11:23:00.203761+0000","last_became_active":"2023-10-14T11:22:57.595229+0000","last_became_peered":"2023-10-14T11:22:57.595229+0000","last_unstale":"2023-10-14T11:23:00.203761+0000","last_undegraded":"2023-10-14T11:23:00.203761+0000","last_fullsized":"2023-10-14T11:23:00.203761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203400+0000","last_change":"2023-10-14T11:22:58.617721+0000","last_active":"2023-10-14T11:23:00.203400+0000","last_peered":"2023-10-14T11:23:00.203400+0000","last_clean":"2023-10-14T11:23:00.203400+0000","last_became_active":"2023-10-14T11:22:58.617363+0000","last_became_peered":"2023-10-14T11:22:58.617363+0000","last_unstale":"2023-10-14T11:23:00.203400+0000","last_undegraded":"2023-10-14T11:23:00.203400+0000","last_fullsized":"2023-10-14T11:23:00.203400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:09.703756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618467+0000","last_change":"2023-10-14T11:22:57.607719+0000","last_active":"2023-10-14T11:22:59.618467+0000","last_peered":"2023-10-14T11:22:59.618467+0000","last_clean":"2023-10-14T11:22:59.618467+0000","last_became_active":"2023-10-14T11:22:57.607364+0000","last_became_peered":"2023-10-14T11:22:57.607364+0000","last_unstale":"2023-10-14T11:22:59.618467+0000","last_undegraded":"2023-10-14T11:22:59.618467+0000","last_fullsized":"2023-10-14T11:22:59.618467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427266+0000","last_change":"2023-10-14T11:22:58.634366+0000","last_active":"2023-10-14T11:23:00.427266+0000","last_peered":"2023-10-14T11:23:00.427266+0000","last_clean":"2023-10-14T11:23:00.427266+0000","last_became_active":"2023-10-14T11:22:58.634138+0000","last_became_peered":"2023-10-14T11:22:58.634138+0000","last_unstale":"2023-10-14T11:23:00.427266+0000","last_undegraded":"2023-10-14T11:23:00.427266+0000","last_fullsized":"2023-10-14T11:23:00.427266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619102+0000","last_change":"2023-10-14T11:22:57.597846+0000","last_active":"2023-10-14T11:22:59.619102+0000","last_peered":"2023-10-14T11:22:59.619102+0000","last_clean":"2023-10-14T11:22:59.619102+0000","last_became_active":"2023-10-14T11:22:57.597524+0000","last_became_peered":"2023-10-14T11:22:57.597524+0000","last_unstale":"2023-10-14T11:22:59.619102+0000","last_undegraded":"2023-10-14T11:22:59.619102+0000","last_fullsized":"2023-10-14T11:22:59.619102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619170+0000","last_change":"2023-10-14T11:22:58.616377+0000","last_active":"2023-10-14T11:22:59.619170+0000","last_peered":"2023-10-14T11:22:59.619170+0000","last_clean":"2023-10-14T11:22:59.619170+0000","last_became_active":"2023-10-14T11:22:58.616115+0000","last_became_peered":"2023-10-14T11:22:58.616115+0000","last_unstale":"2023-10-14T11:22:59.619170+0000","last_undegraded":"2023-10-14T11:22:59.619170+0000","last_fullsized":"2023-10-14T11:22:59.619170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426474+0000","last_change":"2023-10-14T11:22:57.604681+0000","last_active":"2023-10-14T11:23:00.426474+0000","last_peered":"2023-10-14T11:23:00.426474+0000","last_clean":"2023-10-14T11:23:00.426474+0000","last_became_active":"2023-10-14T11:22:57.604355+0000","last_became_peered":"2023-10-14T11:22:57.604355+0000","last_unstale":"2023-10-14T11:23:00.426474+0000","last_undegraded":"2023-10-14T11:23:00.426474+0000","last_fullsized":"2023-10-14T11:23:00.426474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426914+0000","last_change":"2023-10-14T11:22:58.633870+0000","last_active":"2023-10-14T11:23:00.426914+0000","last_peered":"2023-10-14T11:23:00.426914+0000","last_clean":"2023-10-14T11:23:00.426914+0000","last_became_active":"2023-10-14T11:22:58.633668+0000","last_became_peered":"2023-10-14T11:22:58.633668+0000","last_unstale":"2023-10-14T11:23:00.426914+0000","last_undegraded":"2023-10-14T11:23:00.426914+0000","last_fullsized":"2023-10-14T11:23:00.426914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919292+0000","last_change":"2023-10-14T11:22:57.596605+0000","last_active":"2023-10-14T11:22:59.919292+0000","last_peered":"2023-10-14T11:22:59.919292+0000","last_clean":"2023-10-14T11:22:59.919292+0000","last_became_active":"2023-10-14T11:22:57.596284+0000","last_became_peered":"2023-10-14T11:22:57.596284+0000","last_unstale":"2023-10-14T11:22:59.919292+0000","last_undegraded":"2023-10-14T11:22:59.919292+0000","last_fullsized":"2023-10-14T11:22:59.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427249+0000","last_change":"2023-10-14T11:22:58.628154+0000","last_active":"2023-10-14T11:23:00.427249+0000","last_peered":"2023-10-14T11:23:00.427249+0000","last_clean":"2023-10-14T11:23:00.427249+0000","last_became_active":"2023-10-14T11:22:58.627867+0000","last_became_peered":"2023-10-14T11:22:58.627867+0000","last_unstale":"2023-10-14T11:23:00.427249+0000","last_undegraded":"2023-10-14T11:23:00.427249+0000","last_fullsized":"2023-10-14T11:23:00.427249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617938+0000","last_change":"2023-10-14T11:22:57.603369+0000","last_active":"2023-10-14T11:22:59.617938+0000","last_peered":"2023-10-14T11:22:59.617938+0000","last_clean":"2023-10-14T11:22:59.617938+0000","last_became_active":"2023-10-14T11:22:57.603018+0000","last_became_peered":"2023-10-14T11:22:57.603018+0000","last_unstale":"2023-10-14T11:22:59.617938+0000","last_undegraded":"2023-10-14T11:22:59.617938+0000","last_fullsized":"2023-10-14T11:22:59.617938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618471+0000","last_change":"2023-10-14T11:22:58.631463+0000","last_active":"2023-10-14T11:22:59.618471+0000","last_peered":"2023-10-14T11:22:59.618471+0000","last_clean":"2023-10-14T11:22:59.618471+0000","last_became_active":"2023-10-14T11:22:58.630763+0000","last_became_peered":"2023-10-14T11:22:58.630763+0000","last_unstale":"2023-10-14T11:22:59.618471+0000","last_undegraded":"2023-10-14T11:22:59.618471+0000","last_fullsized":"2023-10-14T11:22:59.618471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618387+0000","last_change":"2023-10-14T11:22:57.604539+0000","last_active":"2023-10-14T11:22:59.618387+0000","last_peered":"2023-10-14T11:22:59.618387+0000","last_clean":"2023-10-14T11:22:59.618387+0000","last_became_active":"2023-10-14T11:22:57.604263+0000","last_became_peered":"2023-10-14T11:22:57.604263+0000","last_unstale":"2023-10-14T11:22:59.618387+0000","last_undegraded":"2023-10-14T11:22:59.618387+0000","last_fullsized":"2023-10-14T11:22:59.618387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919024+0000","last_change":"2023-10-14T11:22:58.632118+0000","last_active":"2023-10-14T11:22:59.919024+0000","last_peered":"2023-10-14T11:22:59.919024+0000","last_clean":"2023-10-14T11:22:59.919024+0000","last_became_active":"2023-10-14T11:22:58.631651+0000","last_became_peered":"2023-10-14T11:22:58.631651+0000","last_unstale":"2023-10-14T11:22:59.919024+0000","last_undegraded":"2023-10-14T11:22:59.919024+0000","last_fullsized":"2023-10-14T11:22:59.919024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617780+0000","last_change":"2023-10-14T11:22:58.622493+0000","last_active":"2023-10-14T11:22:59.617780+0000","last_peered":"2023-10-14T11:22:59.617780+0000","last_clean":"2023-10-14T11:22:59.617780+0000","last_became_active":"2023-10-14T11:22:58.622121+0000","last_became_peered":"2023-10-14T11:22:58.622121+0000","last_unstale":"2023-10-14T11:22:59.617780+0000","last_undegraded":"2023-10-14T11:22:59.617780+0000","last_fullsized":"2023-10-14T11:22:59.617780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426598+0000","last_change":"2023-10-14T11:22:57.607846+0000","last_active":"2023-10-14T11:23:00.426598+0000","last_peered":"2023-10-14T11:23:00.426598+0000","last_clean":"2023-10-14T11:23:00.426598+0000","last_became_active":"2023-10-14T11:22:57.607545+0000","last_became_peered":"2023-10-14T11:22:57.607545+0000","last_unstale":"2023-10-14T11:23:00.426598+0000","last_undegraded":"2023-10-14T11:23:00.426598+0000","last_fullsized":"2023-10-14T11:23:00.426598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426906+0000","last_change":"2023-10-14T11:22:58.634690+0000","last_active":"2023-10-14T11:23:00.426906+0000","last_peered":"2023-10-14T11:23:00.426906+0000","last_clean":"2023-10-14T11:23:00.426906+0000","last_became_active":"2023-10-14T11:22:58.634441+0000","last_became_peered":"2023-10-14T11:22:58.634441+0000","last_unstale":"2023-10-14T11:23:00.426906+0000","last_undegraded":"2023-10-14T11:23:00.426906+0000","last_fullsized":"2023-10-14T11:23:00.426906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617821+0000","last_change":"2023-10-14T11:22:57.606397+0000","last_active":"2023-10-14T11:22:59.617821+0000","last_peered":"2023-10-14T11:22:59.617821+0000","last_clean":"2023-10-14T11:22:59.617821+0000","last_became_active":"2023-10-14T11:22:57.606142+0000","last_became_peered":"2023-10-14T11:22:57.606142+0000","last_unstale":"2023-10-14T11:22:59.617821+0000","last_undegraded":"2023-10-14T11:22:59.617821+0000","last_fullsized":"2023-10-14T11:22:59.617821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T11:22:58.611333+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:22:58.611333+0000","last_peered":"2023-10-14T11:22:58.611333+0000","last_clean":"2023-10-14T11:22:58.611333+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:22:58.611333+0000","last_undegraded":"2023-10-14T11:22:58.611333+0000","last_fullsized":"2023-10-14T11:22:58.611333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203375+0000","last_change":"2023-10-14T11:22:58.619533+0000","last_active":"2023-10-14T11:23:00.203375+0000","last_peered":"2023-10-14T11:23:00.203375+0000","last_clean":"2023-10-14T11:23:00.203375+0000","last_became_active":"2023-10-14T11:22:58.618854+0000","last_became_peered":"2023-10-14T11:22:58.618854+0000","last_unstale":"2023-10-14T11:23:00.203375+0000","last_undegraded":"2023-10-14T11:23:00.203375+0000","last_fullsized":"2023-10-14T11:23:00.203375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:03.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426745+0000","last_change":"2023-10-14T11:22:57.611514+0000","last_active":"2023-10-14T11:23:00.426745+0000","last_peered":"2023-10-14T11:23:00.426745+0000","last_clean":"2023-10-14T11:23:00.426745+0000","last_became_active":"2023-10-14T11:22:57.611164+0000","last_became_peered":"2023-10-14T11:22:57.611164+0000","last_unstale":"2023-10-14T11:23:00.426745+0000","last_undegraded":"2023-10-14T11:23:00.426745+0000","last_fullsized":"2023-10-14T11:23:00.426745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427204+0000","last_change":"2023-10-14T11:22:57.605364+0000","last_active":"2023-10-14T11:23:00.427204+0000","last_peered":"2023-10-14T11:23:00.427204+0000","last_clean":"2023-10-14T11:23:00.427204+0000","last_became_active":"2023-10-14T11:22:57.605054+0000","last_became_peered":"2023-10-14T11:22:57.605054+0000","last_unstale":"2023-10-14T11:23:00.427204+0000","last_undegraded":"2023-10-14T11:23:00.427204+0000","last_fullsized":"2023-10-14T11:23:00.427204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617883+0000","last_change":"2023-10-14T11:22:58.622614+0000","last_active":"2023-10-14T11:22:59.617883+0000","last_peered":"2023-10-14T11:22:59.617883+0000","last_clean":"2023-10-14T11:22:59.617883+0000","last_became_active":"2023-10-14T11:22:58.622225+0000","last_became_peered":"2023-10-14T11:22:58.622225+0000","last_unstale":"2023-10-14T11:22:59.617883+0000","last_undegraded":"2023-10-14T11:22:59.617883+0000","last_fullsized":"2023-10-14T11:22:59.617883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:01.462849+0000","last_change":"2023-10-14T11:22:57.604443+0000","last_active":"2023-10-14T11:23:01.462849+0000","last_peered":"2023-10-14T11:23:01.462849+0000","last_clean":"2023-10-14T11:23:01.462849+0000","last_became_active":"2023-10-14T11:22:57.604109+0000","last_became_peered":"2023-10-14T11:22:57.604109+0000","last_unstale":"2023-10-14T11:23:01.462849+0000","last_undegraded":"2023-10-14T11:23:01.462849+0000","last_fullsized":"2023-10-14T11:23:01.462849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427299+0000","last_change":"2023-10-14T11:22:58.619248+0000","last_active":"2023-10-14T11:23:00.427299+0000","last_peered":"2023-10-14T11:23:00.427299+0000","last_clean":"2023-10-14T11:23:00.427299+0000","last_became_active":"2023-10-14T11:22:58.618115+0000","last_became_peered":"2023-10-14T11:22:58.618115+0000","last_unstale":"2023-10-14T11:23:00.427299+0000","last_undegraded":"2023-10-14T11:23:00.427299+0000","last_fullsized":"2023-10-14T11:23:00.427299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619698+0000","last_change":"2023-10-14T11:22:57.606345+0000","last_active":"2023-10-14T11:22:59.619698+0000","last_peered":"2023-10-14T11:22:59.619698+0000","last_clean":"2023-10-14T11:22:59.619698+0000","last_became_active":"2023-10-14T11:22:57.606077+0000","last_became_peered":"2023-10-14T11:22:57.606077+0000","last_unstale":"2023-10-14T11:22:59.619698+0000","last_undegraded":"2023-10-14T11:22:59.619698+0000","last_fullsized":"2023-10-14T11:22:59.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203626+0000","last_change":"2023-10-14T11:22:58.619914+0000","last_active":"2023-10-14T11:23:00.203626+0000","last_peered":"2023-10-14T11:23:00.203626+0000","last_clean":"2023-10-14T11:23:00.203626+0000","last_became_active":"2023-10-14T11:22:58.619545+0000","last_became_peered":"2023-10-14T11:22:58.619545+0000","last_unstale":"2023-10-14T11:23:00.203626+0000","last_undegraded":"2023-10-14T11:23:00.203626+0000","last_fullsized":"2023-10-14T11:23:00.203626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426640+0000","last_change":"2023-10-14T11:22:57.606954+0000","last_active":"2023-10-14T11:23:00.426640+0000","last_peered":"2023-10-14T11:23:00.426640+0000","last_clean":"2023-10-14T11:23:00.426640+0000","last_became_active":"2023-10-14T11:22:57.606659+0000","last_became_peered":"2023-10-14T11:22:57.606659+0000","last_unstale":"2023-10-14T11:23:00.426640+0000","last_undegraded":"2023-10-14T11:23:00.426640+0000","last_fullsized":"2023-10-14T11:23:00.426640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918996+0000","last_change":"2023-10-14T11:22:58.622532+0000","last_active":"2023-10-14T11:22:59.918996+0000","last_peered":"2023-10-14T11:22:59.918996+0000","last_clean":"2023-10-14T11:22:59.918996+0000","last_became_active":"2023-10-14T11:22:58.622238+0000","last_became_peered":"2023-10-14T11:22:58.622238+0000","last_unstale":"2023-10-14T11:22:59.918996+0000","last_undegraded":"2023-10-14T11:22:59.918996+0000","last_fullsized":"2023-10-14T11:22:59.918996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:04.332572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617982+0000","last_change":"2023-10-14T11:22:57.608859+0000","last_active":"2023-10-14T11:22:59.617982+0000","last_peered":"2023-10-14T11:22:59.617982+0000","last_clean":"2023-10-14T11:22:59.617982+0000","last_became_active":"2023-10-14T11:22:57.608589+0000","last_became_peered":"2023-10-14T11:22:57.608589+0000","last_unstale":"2023-10-14T11:22:59.617982+0000","last_undegraded":"2023-10-14T11:22:59.617982+0000","last_fullsized":"2023-10-14T11:22:59.617982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426871+0000","last_change":"2023-10-14T11:22:58.616287+0000","last_active":"2023-10-14T11:23:00.426871+0000","last_peered":"2023-10-14T11:23:00.426871+0000","last_clean":"2023-10-14T11:23:00.426871+0000","last_became_active":"2023-10-14T11:22:58.615925+0000","last_became_peered":"2023-10-14T11:22:58.615925+0000","last_unstale":"2023-10-14T11:23:00.426871+0000","last_undegraded":"2023-10-14T11:23:00.426871+0000","last_fullsized":"2023-10-14T11:23:00.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618069+0000","last_change":"2023-10-14T11:22:57.611743+0000","last_active":"2023-10-14T11:22:59.618069+0000","last_peered":"2023-10-14T11:22:59.618069+0000","last_clean":"2023-10-14T11:22:59.618069+0000","last_became_active":"2023-10-14T11:22:57.611456+0000","last_became_peered":"2023-10-14T11:22:57.611456+0000","last_unstale":"2023-10-14T11:22:59.618069+0000","last_undegraded":"2023-10-14T11:22:59.618069+0000","last_fullsized":"2023-10-14T11:22:59.618069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427171+0000","last_change":"2023-10-14T11:22:58.617910+0000","last_active":"2023-10-14T11:23:00.427171+0000","last_peered":"2023-10-14T11:23:00.427171+0000","last_clean":"2023-10-14T11:23:00.427171+0000","last_became_active":"2023-10-14T11:22:58.617592+0000","last_became_peered":"2023-10-14T11:22:58.617592+0000","last_unstale":"2023-10-14T11:23:00.427171+0000","last_undegraded":"2023-10-14T11:23:00.427171+0000","last_fullsized":"2023-10-14T11:23:00.427171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427178+0000","last_change":"2023-10-14T11:22:57.606300+0000","last_active":"2023-10-14T11:23:00.427178+0000","last_peered":"2023-10-14T11:23:00.427178+0000","last_clean":"2023-10-14T11:23:00.427178+0000","last_became_active":"2023-10-14T11:22:57.606037+0000","last_became_peered":"2023-10-14T11:22:57.606037+0000","last_unstale":"2023-10-14T11:23:00.427178+0000","last_undegraded":"2023-10-14T11:23:00.427178+0000","last_fullsized":"2023-10-14T11:23:00.427178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618927+0000","last_change":"2023-10-14T11:22:58.620639+0000","last_active":"2023-10-14T11:22:59.618927+0000","last_peered":"2023-10-14T11:22:59.618927+0000","last_clean":"2023-10-14T11:22:59.618927+0000","last_became_active":"2023-10-14T11:22:58.620323+0000","last_became_peered":"2023-10-14T11:22:58.620323+0000","last_unstale":"2023-10-14T11:22:59.618927+0000","last_undegraded":"2023-10-14T11:22:59.618927+0000","last_fullsized":"2023-10-14T11:22:59.618927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427113+0000","last_change":"2023-10-14T11:22:57.604253+0000","last_active":"2023-10-14T11:23:00.427113+0000","last_peered":"2023-10-14T11:23:00.427113+0000","last_clean":"2023-10-14T11:23:00.427113+0000","last_became_active":"2023-10-14T11:22:57.603834+0000","last_became_peered":"2023-10-14T11:22:57.603834+0000","last_unstale":"2023-10-14T11:23:00.427113+0000","last_undegraded":"2023-10-14T11:23:00.427113+0000","last_fullsized":"2023-10-14T11:23:00.427113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427260+0000","last_change":"2023-10-14T11:22:58.637349+0000","last_active":"2023-10-14T11:23:00.427260+0000","last_peered":"2023-10-14T11:23:00.427260+0000","last_clean":"2023-10-14T11:23:00.427260+0000","last_became_active":"2023-10-14T11:22:58.636859+0000","last_became_peered":"2023-10-14T11:22:58.636859+0000","last_unstale":"2023-10-14T11:23:00.427260+0000","last_undegraded":"2023-10-14T11:23:00.427260+0000","last_fullsized":"2023-10-14T11:23:00.427260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617923+0000","last_change":"2023-10-14T11:22:57.603889+0000","last_active":"2023-10-14T11:22:59.617923+0000","last_peered":"2023-10-14T11:22:59.617923+0000","last_clean":"2023-10-14T11:22:59.617923+0000","last_became_active":"2023-10-14T11:22:57.603358+0000","last_became_peered":"2023-10-14T11:22:57.603358+0000","last_unstale":"2023-10-14T11:22:59.617923+0000","last_undegraded":"2023-10-14T11:22:59.617923+0000","last_fullsized":"2023-10-14T11:22:59.617923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618346+0000","last_change":"2023-10-14T11:22:58.635498+0000","last_active":"2023-10-14T11:22:59.618346+0000","last_peered":"2023-10-14T11:22:59.618346+0000","last_clean":"2023-10-14T11:22:59.618346+0000","last_became_active":"2023-10-14T11:22:58.635215+0000","last_became_peered":"2023-10-14T11:22:58.635215+0000","last_unstale":"2023-10-14T11:22:59.618346+0000","last_undegraded":"2023-10-14T11:22:59.618346+0000","last_fullsized":"2023-10-14T11:22:59.618346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427227+0000","last_change":"2023-10-14T11:22:57.606591+0000","last_active":"2023-10-14T11:23:00.427227+0000","last_peered":"2023-10-14T11:23:00.427227+0000","last_clean":"2023-10-14T11:23:00.427227+0000","last_became_active":"2023-10-14T11:22:57.606272+0000","last_became_peered":"2023-10-14T11:22:57.606272+0000","last_unstale":"2023-10-14T11:23:00.427227+0000","last_undegraded":"2023-10-14T11:23:00.427227+0000","last_fullsized":"2023-10-14T11:23:00.427227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:07.081725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427267+0000","last_change":"2023-10-14T11:22:58.624516+0000","last_active":"2023-10-14T11:23:00.427267+0000","last_peered":"2023-10-14T11:23:00.427267+0000","last_clean":"2023-10-14T11:23:00.427267+0000","last_became_active":"2023-10-14T11:22:58.624262+0000","last_became_peered":"2023-10-14T11:22:58.624262+0000","last_unstale":"2023-10-14T11:23:00.427267+0000","last_undegraded":"2023-10-14T11:23:00.427267+0000","last_fullsized":"2023-10-14T11:23:00.427267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:41.568935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619150+0000","last_change":"2023-10-14T11:22:58.615924+0000","last_active":"2023-10-14T11:22:59.619150+0000","last_peered":"2023-10-14T11:22:59.619150+0000","last_clean":"2023-10-14T11:22:59.619150+0000","last_became_active":"2023-10-14T11:22:58.615653+0000","last_became_peered":"2023-10-14T11:22:58.615653+0000","last_unstale":"2023-10-14T11:22:59.619150+0000","last_undegraded":"2023-10-14T11:22:59.619150+0000","last_fullsized":"2023-10-14T11:22:59.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426889+0000","last_change":"2023-10-14T11:22:58.634167+0000","last_active":"2023-10-14T11:23:00.426889+0000","last_peered":"2023-10-14T11:23:00.426889+0000","last_clean":"2023-10-14T11:23:00.426889+0000","last_became_active":"2023-10-14T11:22:58.633831+0000","last_became_peered":"2023-10-14T11:22:58.633831+0000","last_unstale":"2023-10-14T11:23:00.426889+0000","last_undegraded":"2023-10-14T11:23:00.426889+0000","last_fullsized":"2023-10-14T11:23:00.426889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618281+0000","last_change":"2023-10-14T11:22:58.632601+0000","last_active":"2023-10-14T11:22:59.618281+0000","last_peered":"2023-10-14T11:22:59.618281+0000","last_clean":"2023-10-14T11:22:59.618281+0000","last_became_active":"2023-10-14T11:22:58.631418+0000","last_became_peered":"2023-10-14T11:22:58.631418+0000","last_unstale":"2023-10-14T11:22:59.618281+0000","last_undegraded":"2023-10-14T11:22:59.618281+0000","last_fullsized":"2023-10-14T11:22:59.618281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203655+0000","last_change":"2023-10-14T11:22:58.622439+0000","last_active":"2023-10-14T11:23:00.203655+0000","last_peered":"2023-10-14T11:23:00.203655+0000","last_clean":"2023-10-14T11:23:00.203655+0000","last_became_active":"2023-10-14T11:22:58.621939+0000","last_became_peered":"2023-10-14T11:22:58.621939+0000","last_unstale":"2023-10-14T11:23:00.203655+0000","last_undegraded":"2023-10-14T11:23:00.203655+0000","last_fullsized":"2023-10-14T11:23:00.203655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427574+0000","last_change":"2023-10-14T11:22:58.626653+0000","last_active":"2023-10-14T11:23:00.427574+0000","last_peered":"2023-10-14T11:23:00.427574+0000","last_clean":"2023-10-14T11:23:00.427574+0000","last_became_active":"2023-10-14T11:22:58.626288+0000","last_became_peered":"2023-10-14T11:22:58.626288+0000","last_unstale":"2023-10-14T11:23:00.427574+0000","last_undegraded":"2023-10-14T11:23:00.427574+0000","last_fullsized":"2023-10-14T11:23:00.427574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617858+0000","last_change":"2023-10-14T11:22:58.621575+0000","last_active":"2023-10-14T11:22:59.617858+0000","last_peered":"2023-10-14T11:22:59.617858+0000","last_clean":"2023-10-14T11:22:59.617858+0000","last_became_active":"2023-10-14T11:22:58.621301+0000","last_became_peered":"2023-10-14T11:22:58.621301+0000","last_unstale":"2023-10-14T11:22:59.617858+0000","last_undegraded":"2023-10-14T11:22:59.617858+0000","last_fullsized":"2023-10-14T11:22:59.617858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619414+0000","last_change":"2023-10-14T11:22:58.617260+0000","last_active":"2023-10-14T11:22:59.619414+0000","last_peered":"2023-10-14T11:22:59.619414+0000","last_clean":"2023-10-14T11:22:59.619414+0000","last_became_active":"2023-10-14T11:22:58.616942+0000","last_became_peered":"2023-10-14T11:22:58.616942+0000","last_unstale":"2023-10-14T11:22:59.619414+0000","last_undegraded":"2023-10-14T11:22:59.619414+0000","last_fullsized":"2023-10-14T11:22:59.619414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427129+0000","last_change":"2023-10-14T11:22:58.625872+0000","last_active":"2023-10-14T11:23:00.427129+0000","last_peered":"2023-10-14T11:23:00.427129+0000","last_clean":"2023-10-14T11:23:00.427129+0000","last_became_active":"2023-10-14T11:22:58.625135+0000","last_became_peered":"2023-10-14T11:22:58.625135+0000","last_unstale":"2023-10-14T11:23:00.427129+0000","last_undegraded":"2023-10-14T11:23:00.427129+0000","last_fullsized":"2023-10-14T11:23:00.427129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618343+0000","last_change":"2023-10-14T11:22:58.632773+0000","last_active":"2023-10-14T11:22:59.618343+0000","last_peered":"2023-10-14T11:22:59.618343+0000","last_clean":"2023-10-14T11:22:59.618343+0000","last_became_active":"2023-10-14T11:22:58.632477+0000","last_became_peered":"2023-10-14T11:22:58.632477+0000","last_unstale":"2023-10-14T11:22:59.618343+0000","last_undegraded":"2023-10-14T11:22:59.618343+0000","last_fullsized":"2023-10-14T11:22:59.618343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426723+0000","last_change":"2023-10-14T11:22:58.626903+0000","last_active":"2023-10-14T11:23:00.426723+0000","last_peered":"2023-10-14T11:23:00.426723+0000","last_clean":"2023-10-14T11:23:00.426723+0000","last_became_active":"2023-10-14T11:22:58.625083+0000","last_became_peered":"2023-10-14T11:22:58.625083+0000","last_unstale":"2023-10-14T11:23:00.426723+0000","last_undegraded":"2023-10-14T11:23:00.426723+0000","last_fullsized":"2023-10-14T11:23:00.426723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618096+0000","last_change":"2023-10-14T11:22:58.631322+0000","last_active":"2023-10-14T11:22:59.618096+0000","last_peered":"2023-10-14T11:22:59.618096+0000","last_clean":"2023-10-14T11:22:59.618096+0000","last_became_active":"2023-10-14T11:22:58.631036+0000","last_became_peered":"2023-10-14T11:22:58.631036+0000","last_unstale":"2023-10-14T11:22:59.618096+0000","last_undegraded":"2023-10-14T11:22:59.618096+0000","last_fullsized":"2023-10-14T11:22:59.618096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203634+0000","last_change":"2023-10-14T11:22:58.622242+0000","last_active":"2023-10-14T11:23:00.203634+0000","last_peered":"2023-10-14T11:23:00.203634+0000","last_clean":"2023-10-14T11:23:00.203634+0000","last_became_active":"2023-10-14T11:22:58.621364+0000","last_became_peered":"2023-10-14T11:22:58.621364+0000","last_unstale":"2023-10-14T11:23:00.203634+0000","last_undegraded":"2023-10-14T11:23:00.203634+0000","last_fullsized":"2023-10-14T11:23:00.203634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619405+0000","last_change":"2023-10-14T11:22:58.624828+0000","last_active":"2023-10-14T11:22:59.619405+0000","last_peered":"2023-10-14T11:22:59.619405+0000","last_clean":"2023-10-14T11:22:59.619405+0000","last_became_active":"2023-10-14T11:22:58.624570+0000","last_became_peered":"2023-10-14T11:22:58.624570+0000","last_unstale":"2023-10-14T11:22:59.619405+0000","last_undegraded":"2023-10-14T11:22:59.619405+0000","last_fullsized":"2023-10-14T11:22:59.619405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:07.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:07.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.765+0000 7f5413f79700 1 Processor -- start 2023-10-14T11:23:07.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.765+0000 7f5413f79700 1 -- start start 2023-10-14T11:23:07.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5413f79700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f540c15e4a0 0x7f540c0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5413f79700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0cfa80 con 0x7f540c15e0c0 2023-10-14T11:23:07.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5413f79700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0cfd60 con 0x7f540c0c52c0 2023-10-14T11:23:07.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5413f79700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0d0040 con 0x7f540c15e4a0 2023-10-14T11:23:07.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5411514700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f540c15e4a0 0x7f540c0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5411d15700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f540c15e0c0 0x7f540c072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40976/0 (socket says 172.21.15.67:40976) 2023-10-14T11:23:07.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5411514700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f540c15e4a0 0x7f540c0cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41684/0 (socket says 172.21.15.67:41684) 2023-10-14T11:23:07.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5411d15700 1 -- 172.21.15.67:0/3957120207 learned_addr learned my addr 172.21.15.67:0/3957120207 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:07.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5410d13700 1 -- 172.21.15.67:0/3957120207 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969792226 0 0) 0x7f540c0cfa80 con 0x7f540c15e0c0 2023-10-14T11:23:07.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.766+0000 7f5410d13700 1 -- 172.21.15.67:0/3957120207 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f80035b0 con 0x7f540c15e0c0 2023-10-14T11:23:07.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5411514700 1 -- 172.21.15.67:0/3957120207 >> v1:172.21.15.72:6789/0 conn(0x7f540c0c52c0 legacy=0x7f540c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5411514700 1 -- 172.21.15.67:0/3957120207 >> v1:172.21.15.67:6789/0 conn(0x7f540c15e0c0 legacy=0x7f540c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5411514700 1 -- 172.21.15.67:0/3957120207 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c06f570 con 0x7f540c15e4a0 2023-10-14T11:23:07.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5411514700 1 --2- 172.21.15.67:0/3957120207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e4a0 0x7f540c0cf1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5408009870 tx=0x7f5408009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292d59f81c269739 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5410d13700 1 -- 172.21.15.67:0/3957120207 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011830 con 0x7f540c15e4a0 2023-10-14T11:23:07.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5410d13700 1 -- 172.21.15.67:0/3957120207 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408011990 con 0x7f540c15e4a0 2023-10-14T11:23:07.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5410d13700 1 -- 172.21.15.67:0/3957120207 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011d20 con 0x7f540c15e4a0 2023-10-14T11:23:07.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5413f79700 1 -- 172.21.15.67:0/3957120207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e4a0 msgr2=0x7f540c0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5413f79700 1 --2- 172.21.15.67:0/3957120207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e4a0 0x7f540c0cf1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5408009870 tx=0x7f5408009b80 comp rx=0 tx=0).stop 2023-10-14T11:23:07.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5413f79700 1 -- 172.21.15.67:0/3957120207 shutdown_connections 2023-10-14T11:23:07.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5413f79700 1 --2- 172.21.15.67:0/3957120207 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e4a0 0x7f540c0cf1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.767+0000 7f5413f79700 1 -- 172.21.15.67:0/3957120207 >> 172.21.15.67:0/3957120207 conn(0x7f540c0d0440 msgr2=0x7f540c0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.768+0000 7f5413f79700 1 -- 172.21.15.67:0/3957120207 shutdown_connections 2023-10-14T11:23:07.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.768+0000 7f5413f79700 1 -- 172.21.15.67:0/3957120207 wait complete. 2023-10-14T11:23:07.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 Processor -- start 2023-10-14T11:23:07.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 -- start start 2023-10-14T11:23:07.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c0c52c0 0x7f540c14fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f540c15e4a0 0x7f540c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c151a80 con 0x7f540c15e0c0 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c157800 con 0x7f540c0c52c0 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.769+0000 7f5413f79700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c157ae0 con 0x7f540c15e4a0 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41692/0 (socket says 172.21.15.67:41692) 2023-10-14T11:23:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 -- 172.21.15.67:0/1136283672 learned_addr learned my addr 172.21.15.67:0/1136283672 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411d15700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c0c52c0 0x7f540c14fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5412516700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f540c15e4a0 0x7f540c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 -- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f540c15e4a0 msgr2=0x7f540c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f540c15e4a0 0x7f540c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 -- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c0c52c0 msgr2=0x7f540c14fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c0c52c0 0x7f540c14fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 -- 172.21.15.67:0/1136283672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080094a0 con 0x7f540c15e0c0 2023-10-14T11:23:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5411514700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5408014040 tx=0x7f5408004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080036a0 con 0x7f540c15e0c0 2023-10-14T11:23:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540801f070 con 0x7f540c15e0c0 2023-10-14T11:23:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c157dc0 con 0x7f540c15e0c0 2023-10-14T11:23:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408003a00 con 0x7f540c15e0c0 2023-10-14T11:23:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.770+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c157440 con 0x7f540c15e0c0 2023-10-14T11:23:07.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.771+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c1575d0 con 0x7f540c15e0c0 2023-10-14T11:23:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.771+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5408003b60 con 0x7f540c15e0c0 2023-10-14T11:23:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.772+0000 7f54027fc700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 0x7f53f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.772+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5408021070 con 0x7f540c15e0c0 2023-10-14T11:23:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.772+0000 7f5411d15700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 0x7f53f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:07.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.773+0000 7f5411d15700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 0x7f53f006d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fd0 tx=0x7f53fc007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:07.784 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.776+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5408055e90 con 0x7f540c15e0c0 2023-10-14T11:23:07.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.972+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f540c0cf700 con 0x7f53f006af00 2023-10-14T11:23:07.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.980+0000 7f54027fc700 1 -- 172.21.15.67:0/1136283672 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264548 (secure 0 0 0) 0x7f53fc0058e0 con 0x7f53f006af00 2023-10-14T11:23:07.986 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 msgr2=0x7f53f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 0x7f53f006d3c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007fd0 tx=0x7f53fc007dc0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 msgr2=0x7f540c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5408014040 tx=0x7f5408004750 comp rx=0 tx=0).stop 2023-10-14T11:23:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 shutdown_connections 2023-10-14T11:23:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f540c15e4a0 0x7f540c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f540c0c52c0 0x7f540c14fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f53f006af00 0x7f53f006d3c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 --2- 172.21.15.67:0/1136283672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f540c15e0c0 0x7f540c15a3e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 >> 172.21.15.67:0/1136283672 conn(0x7f540c0d0440 msgr2=0x7f540c150ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 shutdown_connections 2023-10-14T11:23:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:07.983+0000 7f5413f79700 1 -- 172.21.15.67:0/1136283672 wait complete. 2023-10-14T11:23:07.991 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:07.998 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-14T11:23:06.402310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427431+0000","last_change":"2023-10-14T11:22:58.633786+0000","last_active":"2023-10-14T11:23:00.427431+0000","last_peered":"2023-10-14T11:23:00.427431+0000","last_clean":"2023-10-14T11:23:00.427431+0000","last_became_active":"2023-10-14T11:22:58.633501+0000","last_became_peered":"2023-10-14T11:22:58.633501+0000","last_unstale":"2023-10-14T11:23:00.427431+0000","last_undegraded":"2023-10-14T11:23:00.427431+0000","last_fullsized":"2023-10-14T11:23:00.427431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:51:23.198990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618109+0000","last_change":"2023-10-14T11:22:58.622868+0000","last_active":"2023-10-14T11:22:59.618109+0000","last_peered":"2023-10-14T11:22:59.618109+0000","last_clean":"2023-10-14T11:22:59.618109+0000","last_became_active":"2023-10-14T11:22:58.622234+0000","last_became_peered":"2023-10-14T11:22:58.622234+0000","last_unstale":"2023-10-14T11:22:59.618109+0000","last_undegraded":"2023-10-14T11:22:59.618109+0000","last_fullsized":"2023-10-14T11:22:59.618109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203623+0000","last_change":"2023-10-14T11:22:58.624332+0000","last_active":"2023-10-14T11:23:00.203623+0000","last_peered":"2023-10-14T11:23:00.203623+0000","last_clean":"2023-10-14T11:23:00.203623+0000","last_became_active":"2023-10-14T11:22:58.623983+0000","last_became_peered":"2023-10-14T11:22:58.623983+0000","last_unstale":"2023-10-14T11:23:00.203623+0000","last_undegraded":"2023-10-14T11:23:00.203623+0000","last_fullsized":"2023-10-14T11:23:00.203623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618466+0000","last_change":"2023-10-14T11:22:58.633546+0000","last_active":"2023-10-14T11:22:59.618466+0000","last_peered":"2023-10-14T11:22:59.618466+0000","last_clean":"2023-10-14T11:22:59.618466+0000","last_became_active":"2023-10-14T11:22:58.632591+0000","last_became_peered":"2023-10-14T11:22:58.632591+0000","last_unstale":"2023-10-14T11:22:59.618466+0000","last_undegraded":"2023-10-14T11:22:59.618466+0000","last_fullsized":"2023-10-14T11:22:59.618466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427014+0000","last_change":"2023-10-14T11:22:58.625368+0000","last_active":"2023-10-14T11:23:00.427014+0000","last_peered":"2023-10-14T11:23:00.427014+0000","last_clean":"2023-10-14T11:23:00.427014+0000","last_became_active":"2023-10-14T11:22:58.622784+0000","last_became_peered":"2023-10-14T11:22:58.622784+0000","last_unstale":"2023-10-14T11:23:00.427014+0000","last_undegraded":"2023-10-14T11:23:00.427014+0000","last_fullsized":"2023-10-14T11:23:00.427014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617901+0000","last_change":"2023-10-14T11:22:58.639055+0000","last_active":"2023-10-14T11:22:59.617901+0000","last_peered":"2023-10-14T11:22:59.617901+0000","last_clean":"2023-10-14T11:22:59.617901+0000","last_became_active":"2023-10-14T11:22:58.638778+0000","last_became_peered":"2023-10-14T11:22:58.638778+0000","last_unstale":"2023-10-14T11:22:59.617901+0000","last_undegraded":"2023-10-14T11:22:59.617901+0000","last_fullsized":"2023-10-14T11:22:59.617901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426896+0000","last_change":"2023-10-14T11:22:58.627430+0000","last_active":"2023-10-14T11:23:00.426896+0000","last_peered":"2023-10-14T11:23:00.426896+0000","last_clean":"2023-10-14T11:23:00.426896+0000","last_became_active":"2023-10-14T11:22:58.621813+0000","last_became_peered":"2023-10-14T11:22:58.621813+0000","last_unstale":"2023-10-14T11:23:00.426896+0000","last_undegraded":"2023-10-14T11:23:00.426896+0000","last_fullsized":"2023-10-14T11:23:00.426896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426617+0000","last_change":"2023-10-14T11:22:58.634733+0000","last_active":"2023-10-14T11:23:00.426617+0000","last_peered":"2023-10-14T11:23:00.426617+0000","last_clean":"2023-10-14T11:23:00.426617+0000","last_became_active":"2023-10-14T11:22:58.634207+0000","last_became_peered":"2023-10-14T11:22:58.634207+0000","last_unstale":"2023-10-14T11:23:00.426617+0000","last_undegraded":"2023-10-14T11:23:00.426617+0000","last_fullsized":"2023-10-14T11:23:00.426617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427274+0000","last_change":"2023-10-14T11:22:58.637875+0000","last_active":"2023-10-14T11:23:00.427274+0000","last_peered":"2023-10-14T11:23:00.427274+0000","last_clean":"2023-10-14T11:23:00.427274+0000","last_became_active":"2023-10-14T11:22:58.637706+0000","last_became_peered":"2023-10-14T11:22:58.637706+0000","last_unstale":"2023-10-14T11:23:00.427274+0000","last_undegraded":"2023-10-14T11:23:00.427274+0000","last_fullsized":"2023-10-14T11:23:00.427274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:02:14.102087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619647+0000","last_change":"2023-10-14T11:22:58.632598+0000","last_active":"2023-10-14T11:22:59.619647+0000","last_peered":"2023-10-14T11:22:59.619647+0000","last_clean":"2023-10-14T11:22:59.619647+0000","last_became_active":"2023-10-14T11:22:58.632159+0000","last_became_peered":"2023-10-14T11:22:58.632159+0000","last_unstale":"2023-10-14T11:22:59.619647+0000","last_undegraded":"2023-10-14T11:22:59.619647+0000","last_fullsized":"2023-10-14T11:22:59.619647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619162+0000","last_change":"2023-10-14T11:22:58.635248+0000","last_active":"2023-10-14T11:22:59.619162+0000","last_peered":"2023-10-14T11:22:59.619162+0000","last_clean":"2023-10-14T11:22:59.619162+0000","last_became_active":"2023-10-14T11:22:58.634992+0000","last_became_peered":"2023-10-14T11:22:58.634992+0000","last_unstale":"2023-10-14T11:22:59.619162+0000","last_undegraded":"2023-10-14T11:22:59.619162+0000","last_fullsized":"2023-10-14T11:22:59.619162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919307+0000","last_change":"2023-10-14T11:22:58.624511+0000","last_active":"2023-10-14T11:22:59.919307+0000","last_peered":"2023-10-14T11:22:59.919307+0000","last_clean":"2023-10-14T11:22:59.919307+0000","last_became_active":"2023-10-14T11:22:58.623795+0000","last_became_peered":"2023-10-14T11:22:58.623795+0000","last_unstale":"2023-10-14T11:22:59.919307+0000","last_undegraded":"2023-10-14T11:22:59.919307+0000","last_fullsized":"2023-10-14T11:22:59.919307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:18:00.651862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427131+0000","last_change":"2023-10-14T11:22:58.620085+0000","last_active":"2023-10-14T11:23:00.427131+0000","last_peered":"2023-10-14T11:23:00.427131+0000","last_clean":"2023-10-14T11:23:00.427131+0000","last_became_active":"2023-10-14T11:22:58.619466+0000","last_became_peered":"2023-10-14T11:22:58.619466+0000","last_unstale":"2023-10-14T11:23:00.427131+0000","last_undegraded":"2023-10-14T11:23:00.427131+0000","last_fullsized":"2023-10-14T11:23:00.427131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203570+0000","last_change":"2023-10-14T11:22:58.618541+0000","last_active":"2023-10-14T11:23:00.203570+0000","last_peered":"2023-10-14T11:23:00.203570+0000","last_clean":"2023-10-14T11:23:00.203570+0000","last_became_active":"2023-10-14T11:22:58.618206+0000","last_became_peered":"2023-10-14T11:22:58.618206+0000","last_unstale":"2023-10-14T11:23:00.203570+0000","last_undegraded":"2023-10-14T11:23:00.203570+0000","last_fullsized":"2023-10-14T11:23:00.203570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617739+0000","last_change":"2023-10-14T11:22:58.625071+0000","last_active":"2023-10-14T11:22:59.617739+0000","last_peered":"2023-10-14T11:22:59.617739+0000","last_clean":"2023-10-14T11:22:59.617739+0000","last_became_active":"2023-10-14T11:22:58.624786+0000","last_became_peered":"2023-10-14T11:22:58.624786+0000","last_unstale":"2023-10-14T11:22:59.617739+0000","last_undegraded":"2023-10-14T11:22:59.617739+0000","last_fullsized":"2023-10-14T11:22:59.617739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617746+0000","last_change":"2023-10-14T11:22:58.632587+0000","last_active":"2023-10-14T11:22:59.617746+0000","last_peered":"2023-10-14T11:22:59.617746+0000","last_clean":"2023-10-14T11:22:59.617746+0000","last_became_active":"2023-10-14T11:22:58.631338+0000","last_became_peered":"2023-10-14T11:22:58.631338+0000","last_unstale":"2023-10-14T11:22:59.617746+0000","last_undegraded":"2023-10-14T11:22:59.617746+0000","last_fullsized":"2023-10-14T11:22:59.617746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618293+0000","last_change":"2023-10-14T11:22:58.637286+0000","last_active":"2023-10-14T11:22:59.618293+0000","last_peered":"2023-10-14T11:22:59.618293+0000","last_clean":"2023-10-14T11:22:59.618293+0000","last_became_active":"2023-10-14T11:22:58.636987+0000","last_became_peered":"2023-10-14T11:22:58.636987+0000","last_unstale":"2023-10-14T11:22:59.618293+0000","last_undegraded":"2023-10-14T11:22:59.618293+0000","last_fullsized":"2023-10-14T11:22:59.618293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:38.798371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427284+0000","last_change":"2023-10-14T11:22:58.627520+0000","last_active":"2023-10-14T11:23:00.427284+0000","last_peered":"2023-10-14T11:23:00.427284+0000","last_clean":"2023-10-14T11:23:00.427284+0000","last_became_active":"2023-10-14T11:22:58.627210+0000","last_became_peered":"2023-10-14T11:22:58.627210+0000","last_unstale":"2023-10-14T11:23:00.427284+0000","last_undegraded":"2023-10-14T11:23:00.427284+0000","last_fullsized":"2023-10-14T11:23:00.427284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427097+0000","last_change":"2023-10-14T11:22:58.625306+0000","last_active":"2023-10-14T11:23:00.427097+0000","last_peered":"2023-10-14T11:23:00.427097+0000","last_clean":"2023-10-14T11:23:00.427097+0000","last_became_active":"2023-10-14T11:22:58.625026+0000","last_became_peered":"2023-10-14T11:22:58.625026+0000","last_unstale":"2023-10-14T11:23:00.427097+0000","last_undegraded":"2023-10-14T11:23:00.427097+0000","last_fullsized":"2023-10-14T11:23:00.427097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203594+0000","last_change":"2023-10-14T11:22:57.606379+0000","last_active":"2023-10-14T11:23:00.203594+0000","last_peered":"2023-10-14T11:23:00.203594+0000","last_clean":"2023-10-14T11:23:00.203594+0000","last_became_active":"2023-10-14T11:22:57.606084+0000","last_became_peered":"2023-10-14T11:22:57.606084+0000","last_unstale":"2023-10-14T11:23:00.203594+0000","last_undegraded":"2023-10-14T11:23:00.203594+0000","last_fullsized":"2023-10-14T11:23:00.203594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:52:46.618392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427389+0000","last_change":"2023-10-14T11:22:58.617985+0000","last_active":"2023-10-14T11:23:00.427389+0000","last_peered":"2023-10-14T11:23:00.427389+0000","last_clean":"2023-10-14T11:23:00.427389+0000","last_became_active":"2023-10-14T11:22:58.617671+0000","last_became_peered":"2023-10-14T11:22:58.617671+0000","last_unstale":"2023-10-14T11:23:00.427389+0000","last_undegraded":"2023-10-14T11:23:00.427389+0000","last_fullsized":"2023-10-14T11:23:00.427389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427061+0000","last_change":"2023-10-14T11:22:57.606838+0000","last_active":"2023-10-14T11:23:00.427061+0000","last_peered":"2023-10-14T11:23:00.427061+0000","last_clean":"2023-10-14T11:23:00.427061+0000","last_became_active":"2023-10-14T11:22:57.606525+0000","last_became_peered":"2023-10-14T11:22:57.606525+0000","last_unstale":"2023-10-14T11:23:00.427061+0000","last_undegraded":"2023-10-14T11:23:00.427061+0000","last_fullsized":"2023-10-14T11:23:00.427061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203773+0000","last_change":"2023-10-14T11:22:58.635376+0000","last_active":"2023-10-14T11:23:00.203773+0000","last_peered":"2023-10-14T11:23:00.203773+0000","last_clean":"2023-10-14T11:23:00.203773+0000","last_became_active":"2023-10-14T11:22:58.635055+0000","last_became_peered":"2023-10-14T11:22:58.635055+0000","last_unstale":"2023-10-14T11:23:00.203773+0000","last_undegraded":"2023-10-14T11:23:00.203773+0000","last_fullsized":"2023-10-14T11:23:00.203773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427311+0000","last_change":"2023-10-14T11:22:57.606462+0000","last_active":"2023-10-14T11:23:00.427311+0000","last_peered":"2023-10-14T11:23:00.427311+0000","last_clean":"2023-10-14T11:23:00.427311+0000","last_became_active":"2023-10-14T11:22:57.606205+0000","last_became_peered":"2023-10-14T11:22:57.606205+0000","last_unstale":"2023-10-14T11:23:00.427311+0000","last_undegraded":"2023-10-14T11:23:00.427311+0000","last_fullsized":"2023-10-14T11:23:00.427311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619693+0000","last_change":"2023-10-14T11:22:58.634078+0000","last_active":"2023-10-14T11:22:59.619693+0000","last_peered":"2023-10-14T11:22:59.619693+0000","last_clean":"2023-10-14T11:22:59.619693+0000","last_became_active":"2023-10-14T11:22:58.633808+0000","last_became_peered":"2023-10-14T11:22:58.633808+0000","last_unstale":"2023-10-14T11:22:59.619693+0000","last_undegraded":"2023-10-14T11:22:59.619693+0000","last_fullsized":"2023-10-14T11:22:59.619693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426936+0000","last_change":"2023-10-14T11:22:57.608295+0000","last_active":"2023-10-14T11:23:00.426936+0000","last_peered":"2023-10-14T11:23:00.426936+0000","last_clean":"2023-10-14T11:23:00.426936+0000","last_became_active":"2023-10-14T11:22:57.607972+0000","last_became_peered":"2023-10-14T11:22:57.607972+0000","last_unstale":"2023-10-14T11:23:00.426936+0000","last_undegraded":"2023-10-14T11:23:00.426936+0000","last_fullsized":"2023-10-14T11:23:00.426936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:33.504370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618196+0000","last_change":"2023-10-14T11:22:58.633471+0000","last_active":"2023-10-14T11:22:59.618196+0000","last_peered":"2023-10-14T11:22:59.618196+0000","last_clean":"2023-10-14T11:22:59.618196+0000","last_became_active":"2023-10-14T11:22:58.633175+0000","last_became_peered":"2023-10-14T11:22:58.633175+0000","last_unstale":"2023-10-14T11:22:59.618196+0000","last_undegraded":"2023-10-14T11:22:59.618196+0000","last_fullsized":"2023-10-14T11:22:59.618196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427053+0000","last_change":"2023-10-14T11:22:57.608273+0000","last_active":"2023-10-14T11:23:00.427053+0000","last_peered":"2023-10-14T11:23:00.427053+0000","last_clean":"2023-10-14T11:23:00.427053+0000","last_became_active":"2023-10-14T11:22:57.607043+0000","last_became_peered":"2023-10-14T11:22:57.607043+0000","last_unstale":"2023-10-14T11:23:00.427053+0000","last_undegraded":"2023-10-14T11:23:00.427053+0000","last_fullsized":"2023-10-14T11:23:00.427053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918907+0000","last_change":"2023-10-14T11:22:58.618099+0000","last_active":"2023-10-14T11:22:59.918907+0000","last_peered":"2023-10-14T11:22:59.918907+0000","last_clean":"2023-10-14T11:22:59.918907+0000","last_became_active":"2023-10-14T11:22:58.617688+0000","last_became_peered":"2023-10-14T11:22:58.617688+0000","last_unstale":"2023-10-14T11:22:59.918907+0000","last_undegraded":"2023-10-14T11:22:59.918907+0000","last_fullsized":"2023-10-14T11:22:59.918907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:15.501743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619036+0000","last_change":"2023-10-14T11:22:57.596557+0000","last_active":"2023-10-14T11:22:59.619036+0000","last_peered":"2023-10-14T11:22:59.619036+0000","last_clean":"2023-10-14T11:22:59.619036+0000","last_became_active":"2023-10-14T11:22:57.596258+0000","last_became_peered":"2023-10-14T11:22:57.596258+0000","last_unstale":"2023-10-14T11:22:59.619036+0000","last_undegraded":"2023-10-14T11:22:59.619036+0000","last_fullsized":"2023-10-14T11:22:59.619036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203763+0000","last_change":"2023-10-14T11:22:58.624416+0000","last_active":"2023-10-14T11:23:00.203763+0000","last_peered":"2023-10-14T11:23:00.203763+0000","last_clean":"2023-10-14T11:23:00.203763+0000","last_became_active":"2023-10-14T11:22:58.624136+0000","last_became_peered":"2023-10-14T11:22:58.624136+0000","last_unstale":"2023-10-14T11:23:00.203763+0000","last_undegraded":"2023-10-14T11:23:00.203763+0000","last_fullsized":"2023-10-14T11:23:00.203763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426746+0000","last_change":"2023-10-14T11:22:57.607548+0000","last_active":"2023-10-14T11:23:00.426746+0000","last_peered":"2023-10-14T11:23:00.426746+0000","last_clean":"2023-10-14T11:23:00.426746+0000","last_became_active":"2023-10-14T11:22:57.607266+0000","last_became_peered":"2023-10-14T11:22:57.607266+0000","last_unstale":"2023-10-14T11:23:00.426746+0000","last_undegraded":"2023-10-14T11:23:00.426746+0000","last_fullsized":"2023-10-14T11:23:00.426746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427490+0000","last_change":"2023-10-14T11:22:58.627962+0000","last_active":"2023-10-14T11:23:00.427490+0000","last_peered":"2023-10-14T11:23:00.427490+0000","last_clean":"2023-10-14T11:23:00.427490+0000","last_became_active":"2023-10-14T11:22:58.627647+0000","last_became_peered":"2023-10-14T11:22:58.627647+0000","last_unstale":"2023-10-14T11:23:00.427490+0000","last_undegraded":"2023-10-14T11:23:00.427490+0000","last_fullsized":"2023-10-14T11:23:00.427490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:27:52.804290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618403+0000","last_change":"2023-10-14T11:22:57.601447+0000","last_active":"2023-10-14T11:22:59.618403+0000","last_peered":"2023-10-14T11:22:59.618403+0000","last_clean":"2023-10-14T11:22:59.618403+0000","last_became_active":"2023-10-14T11:22:57.601160+0000","last_became_peered":"2023-10-14T11:22:57.601160+0000","last_unstale":"2023-10-14T11:22:59.618403+0000","last_undegraded":"2023-10-14T11:22:59.618403+0000","last_fullsized":"2023-10-14T11:22:59.618403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:29.374621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617889+0000","last_change":"2023-10-14T11:22:58.619189+0000","last_active":"2023-10-14T11:22:59.617889+0000","last_peered":"2023-10-14T11:22:59.617889+0000","last_clean":"2023-10-14T11:22:59.617889+0000","last_became_active":"2023-10-14T11:22:58.618873+0000","last_became_peered":"2023-10-14T11:22:58.618873+0000","last_unstale":"2023-10-14T11:22:59.617889+0000","last_undegraded":"2023-10-14T11:22:59.617889+0000","last_fullsized":"2023-10-14T11:22:59.617889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619790+0000","last_change":"2023-10-14T11:22:57.601166+0000","last_active":"2023-10-14T11:22:59.619790+0000","last_peered":"2023-10-14T11:22:59.619790+0000","last_clean":"2023-10-14T11:22:59.619790+0000","last_became_active":"2023-10-14T11:22:57.600664+0000","last_became_peered":"2023-10-14T11:22:57.600664+0000","last_unstale":"2023-10-14T11:22:59.619790+0000","last_undegraded":"2023-10-14T11:22:59.619790+0000","last_fullsized":"2023-10-14T11:22:59.619790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618932+0000","last_change":"2023-10-14T11:22:58.638814+0000","last_active":"2023-10-14T11:22:59.618932+0000","last_peered":"2023-10-14T11:22:59.618932+0000","last_clean":"2023-10-14T11:22:59.618932+0000","last_became_active":"2023-10-14T11:22:58.638511+0000","last_became_peered":"2023-10-14T11:22:58.638511+0000","last_unstale":"2023-10-14T11:22:59.618932+0000","last_undegraded":"2023-10-14T11:22:59.618932+0000","last_fullsized":"2023-10-14T11:22:59.618932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618785+0000","last_change":"2023-10-14T11:22:57.605185+0000","last_active":"2023-10-14T11:22:59.618785+0000","last_peered":"2023-10-14T11:22:59.618785+0000","last_clean":"2023-10-14T11:22:59.618785+0000","last_became_active":"2023-10-14T11:22:57.604882+0000","last_became_peered":"2023-10-14T11:22:57.604882+0000","last_unstale":"2023-10-14T11:22:59.618785+0000","last_undegraded":"2023-10-14T11:22:59.618785+0000","last_fullsized":"2023-10-14T11:22:59.618785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:09.235781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203726+0000","last_change":"2023-10-14T11:22:58.635766+0000","last_active":"2023-10-14T11:23:00.203726+0000","last_peered":"2023-10-14T11:23:00.203726+0000","last_clean":"2023-10-14T11:23:00.203726+0000","last_became_active":"2023-10-14T11:22:58.635066+0000","last_became_peered":"2023-10-14T11:22:58.635066+0000","last_unstale":"2023-10-14T11:23:00.203726+0000","last_undegraded":"2023-10-14T11:23:00.203726+0000","last_fullsized":"2023-10-14T11:23:00.203726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617960+0000","last_change":"2023-10-14T11:22:57.604629+0000","last_active":"2023-10-14T11:22:59.617960+0000","last_peered":"2023-10-14T11:22:59.617960+0000","last_clean":"2023-10-14T11:22:59.617960+0000","last_became_active":"2023-10-14T11:22:57.604227+0000","last_became_peered":"2023-10-14T11:22:57.604227+0000","last_unstale":"2023-10-14T11:22:59.617960+0000","last_undegraded":"2023-10-14T11:22:59.617960+0000","last_fullsized":"2023-10-14T11:22:59.617960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:02.398422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919288+0000","last_change":"2023-10-14T11:22:58.624704+0000","last_active":"2023-10-14T11:22:59.919288+0000","last_peered":"2023-10-14T11:22:59.919288+0000","last_clean":"2023-10-14T11:22:59.919288+0000","last_became_active":"2023-10-14T11:22:58.624178+0000","last_became_peered":"2023-10-14T11:22:58.624178+0000","last_unstale":"2023-10-14T11:22:59.919288+0000","last_undegraded":"2023-10-14T11:22:59.919288+0000","last_fullsized":"2023-10-14T11:22:59.919288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:55.046916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619299+0000","last_change":"2023-10-14T11:22:57.611378+0000","last_active":"2023-10-14T11:22:59.619299+0000","last_peered":"2023-10-14T11:22:59.619299+0000","last_clean":"2023-10-14T11:22:59.619299+0000","last_became_active":"2023-10-14T11:22:57.611089+0000","last_became_peered":"2023-10-14T11:22:57.611089+0000","last_unstale":"2023-10-14T11:22:59.619299+0000","last_undegraded":"2023-10-14T11:22:59.619299+0000","last_fullsized":"2023-10-14T11:22:59.619299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427075+0000","last_change":"2023-10-14T11:22:58.625644+0000","last_active":"2023-10-14T11:23:00.427075+0000","last_peered":"2023-10-14T11:23:00.427075+0000","last_clean":"2023-10-14T11:23:00.427075+0000","last_became_active":"2023-10-14T11:22:58.621672+0000","last_became_peered":"2023-10-14T11:22:58.621672+0000","last_unstale":"2023-10-14T11:23:00.427075+0000","last_undegraded":"2023-10-14T11:23:00.427075+0000","last_fullsized":"2023-10-14T11:23:00.427075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203761+0000","last_change":"2023-10-14T11:22:57.595554+0000","last_active":"2023-10-14T11:23:00.203761+0000","last_peered":"2023-10-14T11:23:00.203761+0000","last_clean":"2023-10-14T11:23:00.203761+0000","last_became_active":"2023-10-14T11:22:57.595229+0000","last_became_peered":"2023-10-14T11:22:57.595229+0000","last_unstale":"2023-10-14T11:23:00.203761+0000","last_undegraded":"2023-10-14T11:23:00.203761+0000","last_fullsized":"2023-10-14T11:23:00.203761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203400+0000","last_change":"2023-10-14T11:22:58.617721+0000","last_active":"2023-10-14T11:23:00.203400+0000","last_peered":"2023-10-14T11:23:00.203400+0000","last_clean":"2023-10-14T11:23:00.203400+0000","last_became_active":"2023-10-14T11:22:58.617363+0000","last_became_peered":"2023-10-14T11:22:58.617363+0000","last_unstale":"2023-10-14T11:23:00.203400+0000","last_undegraded":"2023-10-14T11:23:00.203400+0000","last_fullsized":"2023-10-14T11:23:00.203400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:09.703756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618467+0000","last_change":"2023-10-14T11:22:57.607719+0000","last_active":"2023-10-14T11:22:59.618467+0000","last_peered":"2023-10-14T11:22:59.618467+0000","last_clean":"2023-10-14T11:22:59.618467+0000","last_became_active":"2023-10-14T11:22:57.607364+0000","last_became_peered":"2023-10-14T11:22:57.607364+0000","last_unstale":"2023-10-14T11:22:59.618467+0000","last_undegraded":"2023-10-14T11:22:59.618467+0000","last_fullsized":"2023-10-14T11:22:59.618467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427266+0000","last_change":"2023-10-14T11:22:58.634366+0000","last_active":"2023-10-14T11:23:00.427266+0000","last_peered":"2023-10-14T11:23:00.427266+0000","last_clean":"2023-10-14T11:23:00.427266+0000","last_became_active":"2023-10-14T11:22:58.634138+0000","last_became_peered":"2023-10-14T11:22:58.634138+0000","last_unstale":"2023-10-14T11:23:00.427266+0000","last_undegraded":"2023-10-14T11:23:00.427266+0000","last_fullsized":"2023-10-14T11:23:00.427266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:32:24.062181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619102+0000","last_change":"2023-10-14T11:22:57.597846+0000","last_active":"2023-10-14T11:22:59.619102+0000","last_peered":"2023-10-14T11:22:59.619102+0000","last_clean":"2023-10-14T11:22:59.619102+0000","last_became_active":"2023-10-14T11:22:57.597524+0000","last_became_peered":"2023-10-14T11:22:57.597524+0000","last_unstale":"2023-10-14T11:22:59.619102+0000","last_undegraded":"2023-10-14T11:22:59.619102+0000","last_fullsized":"2023-10-14T11:22:59.619102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619170+0000","last_change":"2023-10-14T11:22:58.616377+0000","last_active":"2023-10-14T11:22:59.619170+0000","last_peered":"2023-10-14T11:22:59.619170+0000","last_clean":"2023-10-14T11:22:59.619170+0000","last_became_active":"2023-10-14T11:22:58.616115+0000","last_became_peered":"2023-10-14T11:22:58.616115+0000","last_unstale":"2023-10-14T11:22:59.619170+0000","last_undegraded":"2023-10-14T11:22:59.619170+0000","last_fullsized":"2023-10-14T11:22:59.619170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426474+0000","last_change":"2023-10-14T11:22:57.604681+0000","last_active":"2023-10-14T11:23:00.426474+0000","last_peered":"2023-10-14T11:23:00.426474+0000","last_clean":"2023-10-14T11:23:00.426474+0000","last_became_active":"2023-10-14T11:22:57.604355+0000","last_became_peered":"2023-10-14T11:22:57.604355+0000","last_unstale":"2023-10-14T11:23:00.426474+0000","last_undegraded":"2023-10-14T11:23:00.426474+0000","last_fullsized":"2023-10-14T11:23:00.426474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426914+0000","last_change":"2023-10-14T11:22:58.633870+0000","last_active":"2023-10-14T11:23:00.426914+0000","last_peered":"2023-10-14T11:23:00.426914+0000","last_clean":"2023-10-14T11:23:00.426914+0000","last_became_active":"2023-10-14T11:22:58.633668+0000","last_became_peered":"2023-10-14T11:22:58.633668+0000","last_unstale":"2023-10-14T11:23:00.426914+0000","last_undegraded":"2023-10-14T11:23:00.426914+0000","last_fullsized":"2023-10-14T11:23:00.426914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919292+0000","last_change":"2023-10-14T11:22:57.596605+0000","last_active":"2023-10-14T11:22:59.919292+0000","last_peered":"2023-10-14T11:22:59.919292+0000","last_clean":"2023-10-14T11:22:59.919292+0000","last_became_active":"2023-10-14T11:22:57.596284+0000","last_became_peered":"2023-10-14T11:22:57.596284+0000","last_unstale":"2023-10-14T11:22:59.919292+0000","last_undegraded":"2023-10-14T11:22:59.919292+0000","last_fullsized":"2023-10-14T11:22:59.919292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427249+0000","last_change":"2023-10-14T11:22:58.628154+0000","last_active":"2023-10-14T11:23:00.427249+0000","last_peered":"2023-10-14T11:23:00.427249+0000","last_clean":"2023-10-14T11:23:00.427249+0000","last_became_active":"2023-10-14T11:22:58.627867+0000","last_became_peered":"2023-10-14T11:22:58.627867+0000","last_unstale":"2023-10-14T11:23:00.427249+0000","last_undegraded":"2023-10-14T11:23:00.427249+0000","last_fullsized":"2023-10-14T11:23:00.427249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617938+0000","last_change":"2023-10-14T11:22:57.603369+0000","last_active":"2023-10-14T11:22:59.617938+0000","last_peered":"2023-10-14T11:22:59.617938+0000","last_clean":"2023-10-14T11:22:59.617938+0000","last_became_active":"2023-10-14T11:22:57.603018+0000","last_became_peered":"2023-10-14T11:22:57.603018+0000","last_unstale":"2023-10-14T11:22:59.617938+0000","last_undegraded":"2023-10-14T11:22:59.617938+0000","last_fullsized":"2023-10-14T11:22:59.617938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:44.179046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618471+0000","last_change":"2023-10-14T11:22:58.631463+0000","last_active":"2023-10-14T11:22:59.618471+0000","last_peered":"2023-10-14T11:22:59.618471+0000","last_clean":"2023-10-14T11:22:59.618471+0000","last_became_active":"2023-10-14T11:22:58.630763+0000","last_became_peered":"2023-10-14T11:22:58.630763+0000","last_unstale":"2023-10-14T11:22:59.618471+0000","last_undegraded":"2023-10-14T11:22:59.618471+0000","last_fullsized":"2023-10-14T11:22:59.618471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:57.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618387+0000","last_change":"2023-10-14T11:22:57.604539+0000","last_active":"2023-10-14T11:22:59.618387+0000","last_peered":"2023-10-14T11:22:59.618387+0000","last_clean":"2023-10-14T11:22:59.618387+0000","last_became_active":"2023-10-14T11:22:57.604263+0000","last_became_peered":"2023-10-14T11:22:57.604263+0000","last_unstale":"2023-10-14T11:22:59.618387+0000","last_undegraded":"2023-10-14T11:22:59.618387+0000","last_fullsized":"2023-10-14T11:22:59.618387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.919024+0000","last_change":"2023-10-14T11:22:58.632118+0000","last_active":"2023-10-14T11:22:59.919024+0000","last_peered":"2023-10-14T11:22:59.919024+0000","last_clean":"2023-10-14T11:22:59.919024+0000","last_became_active":"2023-10-14T11:22:58.631651+0000","last_became_peered":"2023-10-14T11:22:58.631651+0000","last_unstale":"2023-10-14T11:22:59.919024+0000","last_undegraded":"2023-10-14T11:22:59.919024+0000","last_fullsized":"2023-10-14T11:22:59.919024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617780+0000","last_change":"2023-10-14T11:22:58.622493+0000","last_active":"2023-10-14T11:22:59.617780+0000","last_peered":"2023-10-14T11:22:59.617780+0000","last_clean":"2023-10-14T11:22:59.617780+0000","last_became_active":"2023-10-14T11:22:58.622121+0000","last_became_peered":"2023-10-14T11:22:58.622121+0000","last_unstale":"2023-10-14T11:22:59.617780+0000","last_undegraded":"2023-10-14T11:22:59.617780+0000","last_fullsized":"2023-10-14T11:22:59.617780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426598+0000","last_change":"2023-10-14T11:22:57.607846+0000","last_active":"2023-10-14T11:23:00.426598+0000","last_peered":"2023-10-14T11:23:00.426598+0000","last_clean":"2023-10-14T11:23:00.426598+0000","last_became_active":"2023-10-14T11:22:57.607545+0000","last_became_peered":"2023-10-14T11:22:57.607545+0000","last_unstale":"2023-10-14T11:23:00.426598+0000","last_undegraded":"2023-10-14T11:23:00.426598+0000","last_fullsized":"2023-10-14T11:23:00.426598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:03.327546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426906+0000","last_change":"2023-10-14T11:22:58.634690+0000","last_active":"2023-10-14T11:23:00.426906+0000","last_peered":"2023-10-14T11:23:00.426906+0000","last_clean":"2023-10-14T11:23:00.426906+0000","last_became_active":"2023-10-14T11:22:58.634441+0000","last_became_peered":"2023-10-14T11:22:58.634441+0000","last_unstale":"2023-10-14T11:23:00.426906+0000","last_undegraded":"2023-10-14T11:23:00.426906+0000","last_fullsized":"2023-10-14T11:23:00.426906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617821+0000","last_change":"2023-10-14T11:22:57.606397+0000","last_active":"2023-10-14T11:22:59.617821+0000","last_peered":"2023-10-14T11:22:59.617821+0000","last_clean":"2023-10-14T11:22:59.617821+0000","last_became_active":"2023-10-14T11:22:57.606142+0000","last_became_peered":"2023-10-14T11:22:57.606142+0000","last_unstale":"2023-10-14T11:22:59.617821+0000","last_undegraded":"2023-10-14T11:22:59.617821+0000","last_fullsized":"2023-10-14T11:22:59.617821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-14T11:22:58.611333+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:22:58.611333+0000","last_peered":"2023-10-14T11:22:58.611333+0000","last_clean":"2023-10-14T11:22:58.611333+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:22:58.611333+0000","last_undegraded":"2023-10-14T11:22:58.611333+0000","last_fullsized":"2023-10-14T11:22:58.611333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203375+0000","last_change":"2023-10-14T11:22:58.619533+0000","last_active":"2023-10-14T11:23:00.203375+0000","last_peered":"2023-10-14T11:23:00.203375+0000","last_clean":"2023-10-14T11:23:00.203375+0000","last_became_active":"2023-10-14T11:22:58.618854+0000","last_became_peered":"2023-10-14T11:22:58.618854+0000","last_unstale":"2023-10-14T11:23:00.203375+0000","last_undegraded":"2023-10-14T11:23:00.203375+0000","last_fullsized":"2023-10-14T11:23:00.203375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:57:03.403449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426745+0000","last_change":"2023-10-14T11:22:57.611514+0000","last_active":"2023-10-14T11:23:00.426745+0000","last_peered":"2023-10-14T11:23:00.426745+0000","last_clean":"2023-10-14T11:23:00.426745+0000","last_became_active":"2023-10-14T11:22:57.611164+0000","last_became_peered":"2023-10-14T11:22:57.611164+0000","last_unstale":"2023-10-14T11:23:00.426745+0000","last_undegraded":"2023-10-14T11:23:00.426745+0000","last_fullsized":"2023-10-14T11:23:00.426745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427204+0000","last_change":"2023-10-14T11:22:57.605364+0000","last_active":"2023-10-14T11:23:00.427204+0000","last_peered":"2023-10-14T11:23:00.427204+0000","last_clean":"2023-10-14T11:23:00.427204+0000","last_became_active":"2023-10-14T11:22:57.605054+0000","last_became_peered":"2023-10-14T11:22:57.605054+0000","last_unstale":"2023-10-14T11:23:00.427204+0000","last_undegraded":"2023-10-14T11:23:00.427204+0000","last_fullsized":"2023-10-14T11:23:00.427204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:15.528143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617883+0000","last_change":"2023-10-14T11:22:58.622614+0000","last_active":"2023-10-14T11:22:59.617883+0000","last_peered":"2023-10-14T11:22:59.617883+0000","last_clean":"2023-10-14T11:22:59.617883+0000","last_became_active":"2023-10-14T11:22:58.622225+0000","last_became_peered":"2023-10-14T11:22:58.622225+0000","last_unstale":"2023-10-14T11:22:59.617883+0000","last_undegraded":"2023-10-14T11:22:59.617883+0000","last_fullsized":"2023-10-14T11:22:59.617883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:01.462849+0000","last_change":"2023-10-14T11:22:57.604443+0000","last_active":"2023-10-14T11:23:01.462849+0000","last_peered":"2023-10-14T11:23:01.462849+0000","last_clean":"2023-10-14T11:23:01.462849+0000","last_became_active":"2023-10-14T11:22:57.604109+0000","last_became_peered":"2023-10-14T11:22:57.604109+0000","last_unstale":"2023-10-14T11:23:01.462849+0000","last_undegraded":"2023-10-14T11:23:01.462849+0000","last_fullsized":"2023-10-14T11:23:01.462849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:38.936046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427299+0000","last_change":"2023-10-14T11:22:58.619248+0000","last_active":"2023-10-14T11:23:00.427299+0000","last_peered":"2023-10-14T11:23:00.427299+0000","last_clean":"2023-10-14T11:23:00.427299+0000","last_became_active":"2023-10-14T11:22:58.618115+0000","last_became_peered":"2023-10-14T11:22:58.618115+0000","last_unstale":"2023-10-14T11:23:00.427299+0000","last_undegraded":"2023-10-14T11:23:00.427299+0000","last_fullsized":"2023-10-14T11:23:00.427299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:42.078761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619698+0000","last_change":"2023-10-14T11:22:57.606345+0000","last_active":"2023-10-14T11:22:59.619698+0000","last_peered":"2023-10-14T11:22:59.619698+0000","last_clean":"2023-10-14T11:22:59.619698+0000","last_became_active":"2023-10-14T11:22:57.606077+0000","last_became_peered":"2023-10-14T11:22:57.606077+0000","last_unstale":"2023-10-14T11:22:59.619698+0000","last_undegraded":"2023-10-14T11:22:59.619698+0000","last_fullsized":"2023-10-14T11:22:59.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203626+0000","last_change":"2023-10-14T11:22:58.619914+0000","last_active":"2023-10-14T11:23:00.203626+0000","last_peered":"2023-10-14T11:23:00.203626+0000","last_clean":"2023-10-14T11:23:00.203626+0000","last_became_active":"2023-10-14T11:22:58.619545+0000","last_became_peered":"2023-10-14T11:22:58.619545+0000","last_unstale":"2023-10-14T11:23:00.203626+0000","last_undegraded":"2023-10-14T11:23:00.203626+0000","last_fullsized":"2023-10-14T11:23:00.203626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426640+0000","last_change":"2023-10-14T11:22:57.606954+0000","last_active":"2023-10-14T11:23:00.426640+0000","last_peered":"2023-10-14T11:23:00.426640+0000","last_clean":"2023-10-14T11:23:00.426640+0000","last_became_active":"2023-10-14T11:22:57.606659+0000","last_became_peered":"2023-10-14T11:22:57.606659+0000","last_unstale":"2023-10-14T11:23:00.426640+0000","last_undegraded":"2023-10-14T11:23:00.426640+0000","last_fullsized":"2023-10-14T11:23:00.426640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:34:14.496716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.918996+0000","last_change":"2023-10-14T11:22:58.622532+0000","last_active":"2023-10-14T11:22:59.918996+0000","last_peered":"2023-10-14T11:22:59.918996+0000","last_clean":"2023-10-14T11:22:59.918996+0000","last_became_active":"2023-10-14T11:22:58.622238+0000","last_became_peered":"2023-10-14T11:22:58.622238+0000","last_unstale":"2023-10-14T11:22:59.918996+0000","last_undegraded":"2023-10-14T11:22:59.918996+0000","last_fullsized":"2023-10-14T11:22:59.918996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:15:04.332572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617982+0000","last_change":"2023-10-14T11:22:57.608859+0000","last_active":"2023-10-14T11:22:59.617982+0000","last_peered":"2023-10-14T11:22:59.617982+0000","last_clean":"2023-10-14T11:22:59.617982+0000","last_became_active":"2023-10-14T11:22:57.608589+0000","last_became_peered":"2023-10-14T11:22:57.608589+0000","last_unstale":"2023-10-14T11:22:59.617982+0000","last_undegraded":"2023-10-14T11:22:59.617982+0000","last_fullsized":"2023-10-14T11:22:59.617982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:54.041890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426871+0000","last_change":"2023-10-14T11:22:58.616287+0000","last_active":"2023-10-14T11:23:00.426871+0000","last_peered":"2023-10-14T11:23:00.426871+0000","last_clean":"2023-10-14T11:23:00.426871+0000","last_became_active":"2023-10-14T11:22:58.615925+0000","last_became_peered":"2023-10-14T11:22:58.615925+0000","last_unstale":"2023-10-14T11:23:00.426871+0000","last_undegraded":"2023-10-14T11:23:00.426871+0000","last_fullsized":"2023-10-14T11:23:00.426871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:59:16.533170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618069+0000","last_change":"2023-10-14T11:22:57.611743+0000","last_active":"2023-10-14T11:22:59.618069+0000","last_peered":"2023-10-14T11:22:59.618069+0000","last_clean":"2023-10-14T11:22:59.618069+0000","last_became_active":"2023-10-14T11:22:57.611456+0000","last_became_peered":"2023-10-14T11:22:57.611456+0000","last_unstale":"2023-10-14T11:22:59.618069+0000","last_undegraded":"2023-10-14T11:22:59.618069+0000","last_fullsized":"2023-10-14T11:22:59.618069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:08.698729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427171+0000","last_change":"2023-10-14T11:22:58.617910+0000","last_active":"2023-10-14T11:23:00.427171+0000","last_peered":"2023-10-14T11:23:00.427171+0000","last_clean":"2023-10-14T11:23:00.427171+0000","last_became_active":"2023-10-14T11:22:58.617592+0000","last_became_peered":"2023-10-14T11:22:58.617592+0000","last_unstale":"2023-10-14T11:23:00.427171+0000","last_undegraded":"2023-10-14T11:23:00.427171+0000","last_fullsized":"2023-10-14T11:23:00.427171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:30:03.542900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427178+0000","last_change":"2023-10-14T11:22:57.606300+0000","last_active":"2023-10-14T11:23:00.427178+0000","last_peered":"2023-10-14T11:23:00.427178+0000","last_clean":"2023-10-14T11:23:00.427178+0000","last_became_active":"2023-10-14T11:22:57.606037+0000","last_became_peered":"2023-10-14T11:22:57.606037+0000","last_unstale":"2023-10-14T11:23:00.427178+0000","last_undegraded":"2023-10-14T11:23:00.427178+0000","last_fullsized":"2023-10-14T11:23:00.427178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:20.696709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618927+0000","last_change":"2023-10-14T11:22:58.620639+0000","last_active":"2023-10-14T11:22:59.618927+0000","last_peered":"2023-10-14T11:22:59.618927+0000","last_clean":"2023-10-14T11:22:59.618927+0000","last_became_active":"2023-10-14T11:22:58.620323+0000","last_became_peered":"2023-10-14T11:22:58.620323+0000","last_unstale":"2023-10-14T11:22:59.618927+0000","last_undegraded":"2023-10-14T11:22:59.618927+0000","last_fullsized":"2023-10-14T11:22:59.618927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:39.941072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427113+0000","last_change":"2023-10-14T11:22:57.604253+0000","last_active":"2023-10-14T11:23:00.427113+0000","last_peered":"2023-10-14T11:23:00.427113+0000","last_clean":"2023-10-14T11:23:00.427113+0000","last_became_active":"2023-10-14T11:22:57.603834+0000","last_became_peered":"2023-10-14T11:22:57.603834+0000","last_unstale":"2023-10-14T11:23:00.427113+0000","last_undegraded":"2023-10-14T11:23:00.427113+0000","last_fullsized":"2023-10-14T11:23:00.427113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:03:25.398754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427260+0000","last_change":"2023-10-14T11:22:58.637349+0000","last_active":"2023-10-14T11:23:00.427260+0000","last_peered":"2023-10-14T11:23:00.427260+0000","last_clean":"2023-10-14T11:23:00.427260+0000","last_became_active":"2023-10-14T11:22:58.636859+0000","last_became_peered":"2023-10-14T11:22:58.636859+0000","last_unstale":"2023-10-14T11:23:00.427260+0000","last_undegraded":"2023-10-14T11:23:00.427260+0000","last_fullsized":"2023-10-14T11:23:00.427260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:25.776677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617923+0000","last_change":"2023-10-14T11:22:57.603889+0000","last_active":"2023-10-14T11:22:59.617923+0000","last_peered":"2023-10-14T11:22:59.617923+0000","last_clean":"2023-10-14T11:22:59.617923+0000","last_became_active":"2023-10-14T11:22:57.603358+0000","last_became_peered":"2023-10-14T11:22:57.603358+0000","last_unstale":"2023-10-14T11:22:59.617923+0000","last_undegraded":"2023-10-14T11:22:59.617923+0000","last_fullsized":"2023-10-14T11:22:59.617923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:35.292978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618346+0000","last_change":"2023-10-14T11:22:58.635498+0000","last_active":"2023-10-14T11:22:59.618346+0000","last_peered":"2023-10-14T11:22:59.618346+0000","last_clean":"2023-10-14T11:22:59.618346+0000","last_became_active":"2023-10-14T11:22:58.635215+0000","last_became_peered":"2023-10-14T11:22:58.635215+0000","last_unstale":"2023-10-14T11:22:59.618346+0000","last_undegraded":"2023-10-14T11:22:59.618346+0000","last_fullsized":"2023-10-14T11:22:59.618346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:28:23.478644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427227+0000","last_change":"2023-10-14T11:22:57.606591+0000","last_active":"2023-10-14T11:23:00.427227+0000","last_peered":"2023-10-14T11:23:00.427227+0000","last_clean":"2023-10-14T11:23:00.427227+0000","last_became_active":"2023-10-14T11:22:57.606272+0000","last_became_peered":"2023-10-14T11:22:57.606272+0000","last_unstale":"2023-10-14T11:23:00.427227+0000","last_undegraded":"2023-10-14T11:23:00.427227+0000","last_fullsized":"2023-10-14T11:23:00.427227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:56.578466+0000","last_clean_scrub_stamp":"2023-10-14T11:22:56.578466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:23:07.081725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427267+0000","last_change":"2023-10-14T11:22:58.624516+0000","last_active":"2023-10-14T11:23:00.427267+0000","last_peered":"2023-10-14T11:23:00.427267+0000","last_clean":"2023-10-14T11:23:00.427267+0000","last_became_active":"2023-10-14T11:22:58.624262+0000","last_became_peered":"2023-10-14T11:22:58.624262+0000","last_unstale":"2023-10-14T11:23:00.427267+0000","last_undegraded":"2023-10-14T11:23:00.427267+0000","last_fullsized":"2023-10-14T11:23:00.427267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:18:41.568935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619150+0000","last_change":"2023-10-14T11:22:58.615924+0000","last_active":"2023-10-14T11:22:59.619150+0000","last_peered":"2023-10-14T11:22:59.619150+0000","last_clean":"2023-10-14T11:22:59.619150+0000","last_became_active":"2023-10-14T11:22:58.615653+0000","last_became_peered":"2023-10-14T11:22:58.615653+0000","last_unstale":"2023-10-14T11:22:59.619150+0000","last_undegraded":"2023-10-14T11:22:59.619150+0000","last_fullsized":"2023-10-14T11:22:59.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426889+0000","last_change":"2023-10-14T11:22:58.634167+0000","last_active":"2023-10-14T11:23:00.426889+0000","last_peered":"2023-10-14T11:23:00.426889+0000","last_clean":"2023-10-14T11:23:00.426889+0000","last_became_active":"2023-10-14T11:22:58.633831+0000","last_became_peered":"2023-10-14T11:22:58.633831+0000","last_unstale":"2023-10-14T11:23:00.426889+0000","last_undegraded":"2023-10-14T11:23:00.426889+0000","last_fullsized":"2023-10-14T11:23:00.426889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:58:34.509397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618281+0000","last_change":"2023-10-14T11:22:58.632601+0000","last_active":"2023-10-14T11:22:59.618281+0000","last_peered":"2023-10-14T11:22:59.618281+0000","last_clean":"2023-10-14T11:22:59.618281+0000","last_became_active":"2023-10-14T11:22:58.631418+0000","last_became_peered":"2023-10-14T11:22:58.631418+0000","last_unstale":"2023-10-14T11:22:59.618281+0000","last_undegraded":"2023-10-14T11:22:59.618281+0000","last_fullsized":"2023-10-14T11:22:59.618281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203655+0000","last_change":"2023-10-14T11:22:58.622439+0000","last_active":"2023-10-14T11:23:00.203655+0000","last_peered":"2023-10-14T11:23:00.203655+0000","last_clean":"2023-10-14T11:23:00.203655+0000","last_became_active":"2023-10-14T11:22:58.621939+0000","last_became_peered":"2023-10-14T11:22:58.621939+0000","last_unstale":"2023-10-14T11:23:00.203655+0000","last_undegraded":"2023-10-14T11:23:00.203655+0000","last_fullsized":"2023-10-14T11:23:00.203655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427574+0000","last_change":"2023-10-14T11:22:58.626653+0000","last_active":"2023-10-14T11:23:00.427574+0000","last_peered":"2023-10-14T11:23:00.427574+0000","last_clean":"2023-10-14T11:23:00.427574+0000","last_became_active":"2023-10-14T11:22:58.626288+0000","last_became_peered":"2023-10-14T11:22:58.626288+0000","last_unstale":"2023-10-14T11:23:00.427574+0000","last_undegraded":"2023-10-14T11:23:00.427574+0000","last_fullsized":"2023-10-14T11:23:00.427574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:15:43.990464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.617858+0000","last_change":"2023-10-14T11:22:58.621575+0000","last_active":"2023-10-14T11:22:59.617858+0000","last_peered":"2023-10-14T11:22:59.617858+0000","last_clean":"2023-10-14T11:22:59.617858+0000","last_became_active":"2023-10-14T11:22:58.621301+0000","last_became_peered":"2023-10-14T11:22:58.621301+0000","last_unstale":"2023-10-14T11:22:59.617858+0000","last_undegraded":"2023-10-14T11:22:59.617858+0000","last_fullsized":"2023-10-14T11:22:59.617858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619414+0000","last_change":"2023-10-14T11:22:58.617260+0000","last_active":"2023-10-14T11:22:59.619414+0000","last_peered":"2023-10-14T11:22:59.619414+0000","last_clean":"2023-10-14T11:22:59.619414+0000","last_became_active":"2023-10-14T11:22:58.616942+0000","last_became_peered":"2023-10-14T11:22:58.616942+0000","last_unstale":"2023-10-14T11:22:59.619414+0000","last_undegraded":"2023-10-14T11:22:59.619414+0000","last_fullsized":"2023-10-14T11:22:59.619414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:58:40.586067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.427129+0000","last_change":"2023-10-14T11:22:58.625872+0000","last_active":"2023-10-14T11:23:00.427129+0000","last_peered":"2023-10-14T11:23:00.427129+0000","last_clean":"2023-10-14T11:23:00.427129+0000","last_became_active":"2023-10-14T11:22:58.625135+0000","last_became_peered":"2023-10-14T11:22:58.625135+0000","last_unstale":"2023-10-14T11:23:00.427129+0000","last_undegraded":"2023-10-14T11:23:00.427129+0000","last_fullsized":"2023-10-14T11:23:00.427129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618343+0000","last_change":"2023-10-14T11:22:58.632773+0000","last_active":"2023-10-14T11:22:59.618343+0000","last_peered":"2023-10-14T11:22:59.618343+0000","last_clean":"2023-10-14T11:22:59.618343+0000","last_became_active":"2023-10-14T11:22:58.632477+0000","last_became_peered":"2023-10-14T11:22:58.632477+0000","last_unstale":"2023-10-14T11:22:59.618343+0000","last_undegraded":"2023-10-14T11:22:59.618343+0000","last_fullsized":"2023-10-14T11:22:59.618343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:41:32.132175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.426723+0000","last_change":"2023-10-14T11:22:58.626903+0000","last_active":"2023-10-14T11:23:00.426723+0000","last_peered":"2023-10-14T11:23:00.426723+0000","last_clean":"2023-10-14T11:23:00.426723+0000","last_became_active":"2023-10-14T11:22:58.625083+0000","last_became_peered":"2023-10-14T11:22:58.625083+0000","last_unstale":"2023-10-14T11:23:00.426723+0000","last_undegraded":"2023-10-14T11:23:00.426723+0000","last_fullsized":"2023-10-14T11:23:00.426723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:02:10.240807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.618096+0000","last_change":"2023-10-14T11:22:58.631322+0000","last_active":"2023-10-14T11:22:59.618096+0000","last_peered":"2023-10-14T11:22:59.618096+0000","last_clean":"2023-10-14T11:22:59.618096+0000","last_became_active":"2023-10-14T11:22:58.631036+0000","last_became_peered":"2023-10-14T11:22:58.631036+0000","last_unstale":"2023-10-14T11:22:59.618096+0000","last_undegraded":"2023-10-14T11:22:59.618096+0000","last_fullsized":"2023-10-14T11:22:59.618096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:13.180665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:23:00.203634+0000","last_change":"2023-10-14T11:22:58.622242+0000","last_active":"2023-10-14T11:23:00.203634+0000","last_peered":"2023-10-14T11:23:00.203634+0000","last_clean":"2023-10-14T11:23:00.203634+0000","last_became_active":"2023-10-14T11:22:58.621364+0000","last_became_peered":"2023-10-14T11:22:58.621364+0000","last_unstale":"2023-10-14T11:23:00.203634+0000","last_undegraded":"2023-10-14T11:23:00.203634+0000","last_fullsized":"2023-10-14T11:23:00.203634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:19:21.701736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-14T11:22:59.619405+0000","last_change":"2023-10-14T11:22:58.624828+0000","last_active":"2023-10-14T11:22:59.619405+0000","last_peered":"2023-10-14T11:22:59.619405+0000","last_clean":"2023-10-14T11:22:59.619405+0000","last_became_active":"2023-10-14T11:22:58.624570+0000","last_became_peered":"2023-10-14T11:22:58.624570+0000","last_unstale":"2023-10-14T11:22:59.619405+0000","last_undegraded":"2023-10-14T11:22:59.619405+0000","last_fullsized":"2023-10-14T11:22:59.619405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:57.583493+0000","last_clean_scrub_stamp":"2023-10-14T11:22:57.583493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:19:30.379647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:08.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T11:23:08.004 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T11:23:08.004 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T11:23:08.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T11:23:08.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.158+0000 7f89a9148700 1 Processor -- start 2023-10-14T11:23:08.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.158+0000 7f89a9148700 1 -- start start 2023-10-14T11:23:08.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a9148700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89a415b860 0x7f89a40b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a9148700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40cf4e0 con 0x7f89a40d0b70 2023-10-14T11:23:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a9148700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40cf730 con 0x7f89a40cc2b0 2023-10-14T11:23:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a9148700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a40d00d0 con 0x7f89a415b860 2023-10-14T11:23:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a2d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f89a415b860 0x7f89a40b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a259c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f89a40d0b70 0x7f89a40cbba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:40990/0 (socket says 172.21.15.67:40990) 2023-10-14T11:23:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a259c700 1 -- 172.21.15.67:0/3939922968 learned_addr learned my addr 172.21.15.67:0/3939922968 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a2d9d700 1 -- 172.21.15.67:0/3939922968 >> v1:172.21.15.72:6789/0 conn(0x7f89a40cc2b0 legacy=0x7f89a40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a2d9d700 1 -- 172.21.15.67:0/3939922968 >> v1:172.21.15.67:6789/0 conn(0x7f89a40d0b70 legacy=0x7f89a40cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a2d9d700 1 -- 172.21.15.67:0/3939922968 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40cfa10 con 0x7f89a415b860 2023-10-14T11:23:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.159+0000 7f89a1d9b700 1 -- 172.21.15.67:0/3939922968 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411768046 0 0) 0x7f89a40cf4e0 con 0x7f89a40d0b70 2023-10-14T11:23:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a2d9d700 1 --2- 172.21.15.67:0/3939922968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a415b860 0x7f89a40b6f60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8998009840 tx=0x7f8998009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a228a2a7ab3c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a1d9b700 1 -- 172.21.15.67:0/3939922968 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998011830 con 0x7f89a415b860 2023-10-14T11:23:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a1d9b700 1 -- 172.21.15.67:0/3939922968 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8998011990 con 0x7f89a415b860 2023-10-14T11:23:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a1d9b700 1 -- 172.21.15.67:0/3939922968 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998011d20 con 0x7f89a415b860 2023-10-14T11:23:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 -- 172.21.15.67:0/3939922968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a415b860 msgr2=0x7f89a40b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 --2- 172.21.15.67:0/3939922968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a415b860 0x7f89a40b6f60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8998009840 tx=0x7f8998009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 -- 172.21.15.67:0/3939922968 shutdown_connections 2023-10-14T11:23:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 --2- 172.21.15.67:0/3939922968 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a415b860 0x7f89a40b6f60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 -- 172.21.15.67:0/3939922968 >> 172.21.15.67:0/3939922968 conn(0x7f89a40665a0 msgr2=0x7f89a4066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 -- 172.21.15.67:0/3939922968 shutdown_connections 2023-10-14T11:23:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.160+0000 7f89a9148700 1 -- 172.21.15.67:0/3939922968 wait complete. 2023-10-14T11:23:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.162+0000 7f89a9148700 1 Processor -- start 2023-10-14T11:23:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.162+0000 7f89a9148700 1 -- start start 2023-10-14T11:23:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89a40cc2b0 0x7f89a41f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 0x7f89a41f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a415e4a0 con 0x7f89a40d0b70 2023-10-14T11:23:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40cb470 con 0x7f89a415b860 2023-10-14T11:23:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a9148700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40a9340 con 0x7f89a40cc2b0 2023-10-14T11:23:08.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41702/0 (socket says 172.21.15.67:41702) 2023-10-14T11:23:08.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a259c700 1 -- 172.21.15.67:0/2942083388 learned_addr learned my addr 172.21.15.67:0/2942083388 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:08.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a2d9d700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89a40cc2b0 0x7f89a41f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.163+0000 7f89a359e700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 0x7f89a41f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 -- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89a40cc2b0 msgr2=0x7f89a41f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89a40cc2b0 0x7f89a41f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 -- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 msgr2=0x7f89a41f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 0x7f89a41f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 -- 172.21.15.67:0/2942083388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980094a0 con 0x7f89a40d0b70 2023-10-14T11:23:08.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a359e700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 0x7f89a41f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:08.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a259c700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f899400c520 tx=0x7f899400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994004c80 con 0x7f89a40d0b70 2023-10-14T11:23:08.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994004de0 con 0x7f89a40d0b70 2023-10-14T11:23:08.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a415d820 con 0x7f89a40d0b70 2023-10-14T11:23:08.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994007310 con 0x7f89a40d0b70 2023-10-14T11:23:08.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.164+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a415dde0 con 0x7f89a40d0b70 2023-10-14T11:23:08.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.165+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a404ebb0 con 0x7f89a40d0b70 2023-10-14T11:23:08.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.165+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8994007470 con 0x7f89a40d0b70 2023-10-14T11:23:08.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.166+0000 7f898b7fe700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 0x7f899006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.166+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8994089170 con 0x7f89a40d0b70 2023-10-14T11:23:08.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.166+0000 7f89a2d9d700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 0x7f899006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.166+0000 7f89a2d9d700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 0x7f899006d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89980090b0 tx=0x7f899801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.170+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8994054220 con 0x7f89a40d0b70 2023-10-14T11:23:08.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.421+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89a40b6320 con 0x7f89a40d0b70 2023-10-14T11:23:08.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.421+0000 7f898b7fe700 1 -- 172.21.15.67:0/2942083388 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8994057840 con 0x7f89a40d0b70 2023-10-14T11:23:08.425 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:08.426 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T11:23:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 msgr2=0x7f899006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 0x7f899006d3c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f89980090b0 tx=0x7f899801c040 comp rx=0 tx=0).stop 2023-10-14T11:23:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 msgr2=0x7f89a40a8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f899400c520 tx=0x7f899400c830 comp rx=0 tx=0).stop 2023-10-14T11:23:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 shutdown_connections 2023-10-14T11:23:08.429 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89a415b860 0x7f89a41f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.423+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89a40cc2b0 0x7f89a41f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.424+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f899006af00 0x7f899006d3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.424+0000 7f89a9148700 1 --2- 172.21.15.67:0/2942083388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f89a40d0b70 0x7f89a40a8e00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.430 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.424+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 >> 172.21.15.67:0/2942083388 conn(0x7f89a40665a0 msgr2=0x7f89a40c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.424+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 shutdown_connections 2023-10-14T11:23:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.424+0000 7f89a9148700 1 -- 172.21.15.67:0/2942083388 wait complete. 2023-10-14T11:23:08.439 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T11:23:08.440 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.562+0000 7feb7eeda700 1 Processor -- start 2023-10-14T11:23:08.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.562+0000 7feb7eeda700 1 -- start start 2023-10-14T11:23:08.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7eeda700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb781618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7eeda700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7806d6e0 con 0x7feb7815def0 2023-10-14T11:23:08.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7eeda700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7806cdd0 con 0x7feb78161e10 2023-10-14T11:23:08.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7eeda700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb781622a0 con 0x7feb7806d260 2023-10-14T11:23:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7cc76700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7feb7815def0 0x7feb780cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41002/0 (socket says 172.21.15.67:41002) 2023-10-14T11:23:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb7cc76700 1 -- 172.21.15.67:0/3468924583 learned_addr learned my addr 172.21.15.67:0/3468924583 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:08.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb77fff700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb781618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448337408 0 0) 0x7feb6c001110 con 0x7feb7815def0 2023-10-14T11:23:08.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.563+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb680035b0 con 0x7feb7815def0 2023-10-14T11:23:08.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2354490377 0 0) 0x7feb680035b0 con 0x7feb7815def0 2023-10-14T11:23:08.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 msgr2=0x7feb781618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:08.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb781618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 >> v1:172.21.15.72:6789/0 conn(0x7feb78161e10 legacy=0x7feb7815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7806c1c0 con 0x7feb7815def0 2023-10-14T11:23:08.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7feb6c001800 con 0x7feb7815def0 2023-10-14T11:23:08.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 >> v1:172.21.15.67:6789/0 conn(0x7feb7815def0 legacy=0x7feb780cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb68003a30 0x7feb68003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb68004d90 0x7feb68005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb781622a0 con 0x7feb68004d90 2023-10-14T11:23:08.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6800ba10 con 0x7feb68003a30 2023-10-14T11:23:08.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6800bbd0 con 0x7feb7806d260 2023-10-14T11:23:08.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb68004d90 0x7feb68005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7cc76700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb68003a30 0x7feb68003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb77fff700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 -- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 msgr2=0x7feb68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:08.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb7806d260 0x7feb68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 -- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb68003a30 msgr2=0x7feb68003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb68003a30 0x7feb68003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 -- 172.21.15.67:0/3468924583 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680035b0 con 0x7feb68004d90 2023-10-14T11:23:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.564+0000 7feb7d477700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb68004d90 0x7feb68005210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c290 tx=0x7feb68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bd02122eb504a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70001e70 con 0x7feb68004d90 2023-10-14T11:23:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000ce50 con 0x7feb68004d90 2023-10-14T11:23:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb777fe700 1 -- 172.21.15.67:0/3468924583 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70012660 con 0x7feb68004d90 2023-10-14T11:23:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 -- 172.21.15.67:0/3468924583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb68004d90 msgr2=0x7feb68005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3468924583 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb68004d90 0x7feb68005210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c290 tx=0x7feb68005880 comp rx=0 tx=0).stop 2023-10-14T11:23:08.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7d477700 1 -- 172.21.15.67:0/3468924583 reap_dead start 2023-10-14T11:23:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 -- 172.21.15.67:0/3468924583 shutdown_connections 2023-10-14T11:23:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 -- 172.21.15.67:0/3468924583 >> 172.21.15.67:0/3468924583 conn(0x7feb780d1570 msgr2=0x7feb780d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 -- 172.21.15.67:0/3468924583 shutdown_connections 2023-10-14T11:23:08.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.565+0000 7feb7eeda700 1 -- 172.21.15.67:0/3468924583 wait complete. 2023-10-14T11:23:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.566+0000 7feb7eeda700 1 Processor -- start 2023-10-14T11:23:08.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.566+0000 7feb7eeda700 1 -- start start 2023-10-14T11:23:08.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb68004d90 0x7feb78155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb780c6a30 0x7feb780c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780aebc0 con 0x7feb780ae200 2023-10-14T11:23:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb781e7230 con 0x7feb780c6a30 2023-10-14T11:23:08.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7eeda700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780c7510 con 0x7feb68004d90 2023-10-14T11:23:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7d477700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7d477700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41724/0 (socket says 172.21.15.67:41724) 2023-10-14T11:23:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7d477700 1 -- 172.21.15.67:0/3547499244 learned_addr learned my addr 172.21.15.67:0/3547499244 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb77fff700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb780c6a30 0x7feb780c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.567+0000 7feb7cc76700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb68004d90 0x7feb78155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 -- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb68004d90 msgr2=0x7feb78155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb68004d90 0x7feb78155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 -- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb780c6a30 msgr2=0x7feb780c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb780c6a30 0x7feb780c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 -- 172.21.15.67:0/3547499244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780c77f0 con 0x7feb780ae200 2023-10-14T11:23:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7d477700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb68005830 tx=0x7feb700015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70003e10 con 0x7feb780ae200 2023-10-14T11:23:08.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70005070 con 0x7feb780ae200 2023-10-14T11:23:08.591 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb780c7ad0 con 0x7feb780ae200 2023-10-14T11:23:08.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70005420 con 0x7feb780ae200 2023-10-14T11:23:08.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.568+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb78156070 con 0x7feb780ae200 2023-10-14T11:23:08.592 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.569+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7804ebb0 con 0x7feb780ae200 2023-10-14T11:23:08.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.570+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7feb70023020 con 0x7feb780ae200 2023-10-14T11:23:08.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.570+0000 7feb757fa700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 0x7feb5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.570+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb7008a960 con 0x7feb780ae200 2023-10-14T11:23:08.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.570+0000 7feb7cc76700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 0x7feb5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.571+0000 7feb7cc76700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 0x7feb5c06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb6c001050 tx=0x7feb6c0011c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.574+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7feb70055aa0 con 0x7feb780ae200 2023-10-14T11:23:08.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.779+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb78067320 con 0x7feb780ae200 2023-10-14T11:23:08.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.780+0000 7feb757fa700 1 -- 172.21.15.67:0/3547499244 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7feb7002b070 con 0x7feb780ae200 2023-10-14T11:23:08.783 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:08.784 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:08.785 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 msgr2=0x7feb5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 0x7feb5c06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb6c001050 tx=0x7feb6c0011c0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 msgr2=0x7feb780ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feb68005830 tx=0x7feb700015b0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 shutdown_connections 2023-10-14T11:23:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7feb5c06af00 0x7feb5c06d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7feb780ae200 0x7feb780ae680 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7feb68004d90 0x7feb78155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 --2- 172.21.15.67:0/3547499244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb780c6a30 0x7feb780c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 >> 172.21.15.67:0/3547499244 conn(0x7feb780d1570 msgr2=0x7feb78159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 shutdown_connections 2023-10-14T11:23:08.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.782+0000 7feb7eeda700 1 -- 172.21.15.67:0/3547499244 wait complete. 2023-10-14T11:23:08.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:08.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.924+0000 7fd0ae7a1700 1 Processor -- start 2023-10-14T11:23:08.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.924+0000 7fd0ae7a1700 1 -- start start 2023-10-14T11:23:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0ae7a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 0x7fd0a806a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0ae7a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0a806eb50 0x7fd0a80666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0ae7a1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a815f480 con 0x7fd0a8066be0 2023-10-14T11:23:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0ae7a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80cc510 con 0x7fd0a806eb50 2023-10-14T11:23:08.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0ae7a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815f6d0 con 0x7fd0a806e770 2023-10-14T11:23:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0acd3e700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd0a8066be0 0x7fd0a815c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41026/0 (socket says 172.21.15.67:41026) 2023-10-14T11:23:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0acd3e700 1 -- 172.21.15.67:0/617274022 learned_addr learned my addr 172.21.15.67:0/617274022 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/617274022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 0x7fd0a806a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a77fe700 1 --2- 172.21.15.67:0/617274022 >> v2:172.21.15.72:3300/0 conn(0x7fd0a806eb50 0x7fd0a80666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a6ffd700 1 -- 172.21.15.67:0/617274022 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052428693 0 0) 0x7fd0a815f480 con 0x7fd0a8066be0 2023-10-14T11:23:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a6ffd700 1 -- 172.21.15.67:0/617274022 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0900035b0 con 0x7fd0a8066be0 2023-10-14T11:23:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 -- 172.21.15.67:0/617274022 >> v2:172.21.15.72:3300/0 conn(0x7fd0a806eb50 msgr2=0x7fd0a80666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/617274022 >> v2:172.21.15.72:3300/0 conn(0x7fd0a806eb50 0x7fd0a80666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 -- 172.21.15.67:0/617274022 >> v1:172.21.15.67:6789/0 conn(0x7fd0a8066be0 legacy=0x7fd0a815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 -- 172.21.15.67:0/617274022 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a815f9b0 con 0x7fd0a806e770 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.925+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/617274022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 0x7fd0a806a810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd098009840 tx=0x7fd098009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce5a8bd7fbc70a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0a6ffd700 1 -- 172.21.15.67:0/617274022 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098011830 con 0x7fd0a806e770 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0a6ffd700 1 -- 172.21.15.67:0/617274022 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098011990 con 0x7fd0a806e770 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0a6ffd700 1 -- 172.21.15.67:0/617274022 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098011d00 con 0x7fd0a806e770 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/617274022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 msgr2=0x7fd0a806a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/617274022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 0x7fd0a806a810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd098009840 tx=0x7fd098009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/617274022 shutdown_connections 2023-10-14T11:23:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/617274022 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a806e770 0x7fd0a806a810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/617274022 >> v2:172.21.15.72:3300/0 conn(0x7fd0a806eb50 0x7fd0a80666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/617274022 >> 172.21.15.67:0/617274022 conn(0x7fd0a80b1760 msgr2=0x7fd0a80b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:08.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/617274022 shutdown_connections 2023-10-14T11:23:08.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.926+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/617274022 wait complete. 2023-10-14T11:23:08.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.927+0000 7fd0ae7a1700 1 Processor -- start 2023-10-14T11:23:08.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 -- start start 2023-10-14T11:23:08.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a8066be0 0x7fd0a80c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a806eb50 0x7fd0a80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80c4490 con 0x7fd0a806e770 2023-10-14T11:23:08.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80c4770 con 0x7fd0a806eb50 2023-10-14T11:23:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0ae7a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80c4a50 con 0x7fd0a8066be0 2023-10-14T11:23:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0a77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0a77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41736/0 (socket says 172.21.15.67:41736) 2023-10-14T11:23:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.928+0000 7fd0a77fe700 1 -- 172.21.15.67:0/1117397393 learned_addr learned my addr 172.21.15.67:0/1117397393 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:08.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a8066be0 0x7fd0a80c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0acd3e700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a806eb50 0x7fd0a80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 -- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a8066be0 msgr2=0x7fd0a80c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a8066be0 0x7fd0a80c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 -- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a806eb50 msgr2=0x7fd0a80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:08.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a806eb50 0x7fd0a80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 -- 172.21.15.67:0/1117397393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980094a0 con 0x7fd0a806e770 2023-10-14T11:23:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a77fe700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00e9b0 tx=0x7fd09c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c009710 con 0x7fd0a806e770 2023-10-14T11:23:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00c850 con 0x7fd0a806e770 2023-10-14T11:23:08.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80c4d30 con 0x7fd0a806e770 2023-10-14T11:23:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00cbc0 con 0x7fd0a806e770 2023-10-14T11:23:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.929+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80c37a0 con 0x7fd0a806e770 2023-10-14T11:23:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.930+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80b3790 con 0x7fd0a806e770 2023-10-14T11:23:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.930+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd09c00cd20 con 0x7fd0a806e770 2023-10-14T11:23:08.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.931+0000 7fd0a4ff9700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:08.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.931+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd09c089620 con 0x7fd0a806e770 2023-10-14T11:23:08.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.931+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:08.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.931+0000 7fd0a7fff700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0980090b0 tx=0x7fd09801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:08.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:08.935+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd09c0546d0 con 0x7fd0a806e770 2023-10-14T11:23:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.134+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0a8160230 con 0x7fd0a806e770 2023-10-14T11:23:09.137 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.134+0000 7fd0a4ff9700 1 -- 172.21.15.67:0/1117397393 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0a8160230 con 0x7fd0a806e770 2023-10-14T11:23:09.138 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 msgr2=0x7fd09406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 0x7fd09406d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0980090b0 tx=0x7fd09801c040 comp rx=0 tx=0).stop 2023-10-14T11:23:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 msgr2=0x7fd0a80c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.140 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00e9b0 tx=0x7fd09c00ecc0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 shutdown_connections 2023-10-14T11:23:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a806eb50 0x7fd0a80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a8066be0 0x7fd0a80c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd09406af00 0x7fd09406d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.141 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 --2- 172.21.15.67:0/1117397393 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a806e770 0x7fd0a80c8f10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 >> 172.21.15.67:0/1117397393 conn(0x7fd0a80b1760 msgr2=0x7fd0a80b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 shutdown_connections 2023-10-14T11:23:09.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.136+0000 7fd0ae7a1700 1 -- 172.21.15.67:0/1117397393 wait complete. 2023-10-14T11:23:09.151 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:09.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.276+0000 7ff9771d4700 1 Processor -- start 2023-10-14T11:23:09.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 -- start start 2023-10-14T11:23:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff97006e770 0x7ff97006a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97015f480 con 0x7ff970066be0 2023-10-14T11:23:09.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700cc510 con 0x7ff97006e770 2023-10-14T11:23:09.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.277+0000 7ff9771d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97015f6d0 con 0x7ff97006eb50 2023-10-14T11:23:09.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff974f70700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff97006e770 0x7ff97006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44016/0 (socket says 172.21.15.67:44016) 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 -- 172.21.15.67:0/2541023168 learned_addr learned my addr 172.21.15.67:0/2541023168 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff975771700 1 --1- 172.21.15.67:0/2541023168 >> v1:172.21.15.72:6789/0 conn(0x7ff970066be0 0x7ff97015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47860/0 (socket says 172.21.15.67:47860) 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96f7fe700 1 -- 172.21.15.67:0/2541023168 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269451378 0 0) 0x7ff97015f480 con 0x7ff970066be0 2023-10-14T11:23:09.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 -- 172.21.15.67:0/2541023168 >> v2:172.21.15.72:3300/0 conn(0x7ff97006e770 msgr2=0x7ff97006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 --2- 172.21.15.67:0/2541023168 >> v2:172.21.15.72:3300/0 conn(0x7ff97006e770 0x7ff97006a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 -- 172.21.15.67:0/2541023168 >> v1:172.21.15.72:6789/0 conn(0x7ff970066be0 legacy=0x7ff97015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 -- 172.21.15.67:0/2541023168 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97015f9b0 con 0x7ff97006eb50 2023-10-14T11:23:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96ffff700 1 --2- 172.21.15.67:0/2541023168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098f0 tx=0x7ff95c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46919e28ea0a926 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96f7fe700 1 -- 172.21.15.67:0/2541023168 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011830 con 0x7ff97006eb50 2023-10-14T11:23:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96f7fe700 1 -- 172.21.15.67:0/2541023168 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c011990 con 0x7ff97006eb50 2023-10-14T11:23:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.278+0000 7ff96f7fe700 1 -- 172.21.15.67:0/2541023168 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011d20 con 0x7ff97006eb50 2023-10-14T11:23:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 -- 172.21.15.67:0/2541023168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 msgr2=0x7ff9700666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2541023168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098f0 tx=0x7ff95c009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:09.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 -- 172.21.15.67:0/2541023168 shutdown_connections 2023-10-14T11:23:09.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2541023168 >> v2:172.21.15.72:3300/0 conn(0x7ff97006e770 0x7ff97006a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2541023168 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff9700666a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 -- 172.21.15.67:0/2541023168 >> 172.21.15.67:0/2541023168 conn(0x7ff9700b1760 msgr2=0x7ff9700b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 -- 172.21.15.67:0/2541023168 shutdown_connections 2023-10-14T11:23:09.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.279+0000 7ff9771d4700 1 -- 172.21.15.67:0/2541023168 wait complete. 2023-10-14T11:23:09.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.280+0000 7ff9771d4700 1 Processor -- start 2023-10-14T11:23:09.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.280+0000 7ff9771d4700 1 -- start start 2023-10-14T11:23:09.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97006e770 0x7ff97015dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff97015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700a05e0 con 0x7ff970066be0 2023-10-14T11:23:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9701f11d0 con 0x7ff97006e770 2023-10-14T11:23:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff9771d4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9701f14b0 con 0x7ff97006eb50 2023-10-14T11:23:09.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41748/0 (socket says 172.21.15.67:41748) 2023-10-14T11:23:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 -- 172.21.15.67:0/2255874460 learned_addr learned my addr 172.21.15.67:0/2255874460 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff975771700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff97015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff96ffff700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97006e770 0x7ff97015dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 -- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 msgr2=0x7ff97015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff97015e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 -- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97006e770 msgr2=0x7ff97015dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97006e770 0x7ff97015dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.281+0000 7ff974f70700 1 -- 172.21.15.67:0/2255874460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009550 con 0x7ff970066be0 2023-10-14T11:23:09.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff974f70700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e9b0 tx=0x7ff96400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964009710 con 0x7ff970066be0 2023-10-14T11:23:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96400c850 con 0x7ff970066be0 2023-10-14T11:23:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9701f1790 con 0x7ff970066be0 2023-10-14T11:23:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400cbc0 con 0x7ff970066be0 2023-10-14T11:23:09.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.282+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9701f1d50 con 0x7ff970066be0 2023-10-14T11:23:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.283+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97004ebb0 con 0x7ff970066be0 2023-10-14T11:23:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.283+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff96400cd20 con 0x7ff970066be0 2023-10-14T11:23:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.284+0000 7ff96d7fa700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 0x7ff95406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.284+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff964089770 con 0x7ff970066be0 2023-10-14T11:23:09.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.284+0000 7ff96ffff700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 0x7ff95406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.285+0000 7ff96ffff700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 0x7ff95406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9700c8050 tx=0x7ff95c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.288+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff964054780 con 0x7ff970066be0 2023-10-14T11:23:09.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.490+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff97015ff40 con 0x7ff970066be0 2023-10-14T11:23:09.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.490+0000 7ff96d7fa700 1 -- 172.21.15.67:0/2255874460 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff964057da0 con 0x7ff970066be0 2023-10-14T11:23:09.494 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:09.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 msgr2=0x7ff95406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 0x7ff95406d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9700c8050 tx=0x7ff95c008030 comp rx=0 tx=0).stop 2023-10-14T11:23:09.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 msgr2=0x7ff9700a00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff96400e9b0 tx=0x7ff96400ed70 comp rx=0 tx=0).stop 2023-10-14T11:23:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 shutdown_connections 2023-10-14T11:23:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff97006eb50 0x7ff97015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff95406af00 0x7ff95406d3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff970066be0 0x7ff9700a00a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.497 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 --2- 172.21.15.67:0/2255874460 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff97006e770 0x7ff97015dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 >> 172.21.15.67:0/2255874460 conn(0x7ff9700b1760 msgr2=0x7ff970159820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 shutdown_connections 2023-10-14T11:23:09.498 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.493+0000 7ff9771d4700 1 -- 172.21.15.67:0/2255874460 wait complete. 2023-10-14T11:23:09.508 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:09.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.633+0000 7f07681b0700 1 Processor -- start 2023-10-14T11:23:09.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.633+0000 7f07681b0700 1 -- start start 2023-10-14T11:23:09.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f07681b0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f076015aa60 0x7f07600ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f07681b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07600cd0d0 0x7f07600cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f07681b0700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600ad3c0 con 0x7f076015ae40 2023-10-14T11:23:09.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f07681b0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600d1300 con 0x7f076015aa60 2023-10-14T11:23:09.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f07681b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600ce8f0 con 0x7f07600cd0d0 2023-10-14T11:23:09.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0765f4c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f076015aa60 0x7f07600ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f076574b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f076015ae40 0x7f07600cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41050/0 (socket says 172.21.15.67:41050) 2023-10-14T11:23:09.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f076574b700 1 -- 172.21.15.67:0/1293021427 learned_addr learned my addr 172.21.15.67:0/1293021427 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:09.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f076674d700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07600cd0d0 0x7f07600cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0765f4c700 1 -- 172.21.15.67:0/1293021427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07600cd0d0 msgr2=0x7f07600cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0765f4c700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07600cd0d0 0x7f07600cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0765f4c700 1 -- 172.21.15.67:0/1293021427 >> v1:172.21.15.67:6789/0 conn(0x7f076015ae40 legacy=0x7f07600cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0765f4c700 1 -- 172.21.15.67:0/1293021427 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600ceb50 con 0x7f076015aa60 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.634+0000 7f0764f4a700 1 -- 172.21.15.67:0/1293021427 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343089120 0 0) 0x7f07600ad3c0 con 0x7f076015ae40 2023-10-14T11:23:09.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f0765f4c700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015aa60 0x7f07600ce3b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0750009840 tx=0x7f0750009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9785fdc0dd9783c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f0764f4a700 1 -- 172.21.15.67:0/1293021427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750011830 con 0x7f076015aa60 2023-10-14T11:23:09.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f0764f4a700 1 -- 172.21.15.67:0/1293021427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750011990 con 0x7f076015aa60 2023-10-14T11:23:09.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f0764f4a700 1 -- 172.21.15.67:0/1293021427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750011d20 con 0x7f076015aa60 2023-10-14T11:23:09.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 -- 172.21.15.67:0/1293021427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015aa60 msgr2=0x7f07600ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015aa60 0x7f07600ce3b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0750009840 tx=0x7f0750009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 -- 172.21.15.67:0/1293021427 shutdown_connections 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07600cd0d0 0x7f07600cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 --2- 172.21.15.67:0/1293021427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015aa60 0x7f07600ce3b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 -- 172.21.15.67:0/1293021427 >> 172.21.15.67:0/1293021427 conn(0x7f07600d04b0 msgr2=0x7f07600d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 -- 172.21.15.67:0/1293021427 shutdown_connections 2023-10-14T11:23:09.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.635+0000 7f07681b0700 1 -- 172.21.15.67:0/1293021427 wait complete. 2023-10-14T11:23:09.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 Processor -- start 2023-10-14T11:23:09.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 -- start start 2023-10-14T11:23:09.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07600cd0d0 0x7f076014a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f076015aa60 0x7f076014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076014a7b0 con 0x7f076015ae40 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076015df30 con 0x7f07600cd0d0 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f07681b0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076014c100 con 0x7f076015aa60 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f076674d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f076674d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41766/0 (socket says 172.21.15.67:41766) 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.637+0000 7f076674d700 1 -- 172.21.15.67:0/328497873 learned_addr learned my addr 172.21.15.67:0/328497873 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:09.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076574b700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f076015aa60 0x7f076014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f0765f4c700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07600cd0d0 0x7f076014a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 -- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f076015aa60 msgr2=0x7f076014a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f076015aa60 0x7f076014a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 -- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07600cd0d0 msgr2=0x7f076014a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07600cd0d0 0x7f076014a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 -- 172.21.15.67:0/328497873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500094a0 con 0x7f076015ae40 2023-10-14T11:23:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f076674d700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0758007e40 tx=0x7f075800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800ecd0 con 0x7f076015ae40 2023-10-14T11:23:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075800ee50 con 0x7f076015ae40 2023-10-14T11:23:09.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076014b4f0 con 0x7f076015ae40 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0758014660 con 0x7f076015ae40 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.638+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076014bab0 con 0x7f076015ae40 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.639+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076004ebb0 con 0x7f076015ae40 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.640+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07580147c0 con 0x7f076015ae40 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.640+0000 7f07567fc700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.640+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0758089c10 con 0x7f076015ae40 2023-10-14T11:23:09.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.640+0000 7f0765f4c700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.641+0000 7f0765f4c700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 0x7f074406d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07500090b0 tx=0x7f0750008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.644+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0758054d70 con 0x7f076015ae40 2023-10-14T11:23:09.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.844+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07600d0b40 con 0x7f076015ae40 2023-10-14T11:23:09.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.845+0000 7f07567fc700 1 -- 172.21.15.67:0/328497873 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0758058390 con 0x7f076015ae40 2023-10-14T11:23:09.848 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 msgr2=0x7f074406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 0x7f074406d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f07500090b0 tx=0x7f0750008030 comp rx=0 tx=0).stop 2023-10-14T11:23:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 msgr2=0x7f076014d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0758007e40 tx=0x7f075800e3c0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 shutdown_connections 2023-10-14T11:23:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074406af00 0x7f074406d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f076015ae40 0x7f076014d710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07600cd0d0 0x7f076014a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 --2- 172.21.15.67:0/328497873 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f076015aa60 0x7f076014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.846+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 >> 172.21.15.67:0/328497873 conn(0x7f07600d04b0 msgr2=0x7f0760073890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.847+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 shutdown_connections 2023-10-14T11:23:09.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.847+0000 7f07681b0700 1 -- 172.21.15.67:0/328497873 wait complete. 2023-10-14T11:23:09.862 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:09.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.983+0000 7f79d280b700 1 Processor -- start 2023-10-14T11:23:09.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.983+0000 7f79d280b700 1 -- start start 2023-10-14T11:23:09.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e0c0 0x7f79cc072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 0x7f79cc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79cc0c52c0 0x7f79cc0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc072ac0 con 0x7f79cc0c52c0 2023-10-14T11:23:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79cc0cfa80 con 0x7f79cc15e4a0 2023-10-14T11:23:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d280b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0cfd60 con 0x7f79cc15e0c0 2023-10-14T11:23:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d0da8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79cc0c52c0 0x7f79cc0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d0da8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f79cc0c52c0 0x7f79cc0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41774/0 (socket says 172.21.15.67:41774) 2023-10-14T11:23:09.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79d0da8700 1 -- 172.21.15.67:0/3458707955 learned_addr learned my addr 172.21.15.67:0/3458707955 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:09.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79cbfff700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e0c0 0x7f79cc072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.984+0000 7f79cb7fe700 1 --2- 172.21.15.67:0/3458707955 >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 0x7f79cc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:09.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 -- 172.21.15.67:0/3458707955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e0c0 msgr2=0x7f79cc072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:09.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e0c0 0x7f79cc072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 -- 172.21.15.67:0/3458707955 >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 msgr2=0x7f79cc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:09.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 --2- 172.21.15.67:0/3458707955 >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 0x7f79cc0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 -- 172.21.15.67:0/3458707955 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc0d0040 con 0x7f79cc0c52c0 2023-10-14T11:23:09.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79cb7fe700 1 --2- 172.21.15.67:0/3458707955 >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 0x7f79cc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:09.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d0da8700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc0c52c0 0x7f79cc0c5750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79cc06d460 tx=0x7f79c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aeaccafaeb96b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:09.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79caffd700 1 -- 172.21.15.67:0/3458707955 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c400bbc0 con 0x7f79cc0c52c0 2023-10-14T11:23:09.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79caffd700 1 -- 172.21.15.67:0/3458707955 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c400bd20 con 0x7f79cc0c52c0 2023-10-14T11:23:09.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79caffd700 1 -- 172.21.15.67:0/3458707955 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c40116a0 con 0x7f79cc0c52c0 2023-10-14T11:23:09.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 -- 172.21.15.67:0/3458707955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc0c52c0 msgr2=0x7f79cc0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:09.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc0c52c0 0x7f79cc0c5750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f79cc06d460 tx=0x7f79c400b330 comp rx=0 tx=0).stop 2023-10-14T11:23:09.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 -- 172.21.15.67:0/3458707955 shutdown_connections 2023-10-14T11:23:09.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc0c52c0 0x7f79cc0c5750 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 --2- 172.21.15.67:0/3458707955 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e0c0 0x7f79cc072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 --2- 172.21.15.67:0/3458707955 >> v2:172.21.15.72:3300/0 conn(0x7f79cc15e4a0 0x7f79cc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:09.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 -- 172.21.15.67:0/3458707955 >> 172.21.15.67:0/3458707955 conn(0x7f79cc0d0440 msgr2=0x7f79cc0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:09.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 -- 172.21.15.67:0/3458707955 shutdown_connections 2023-10-14T11:23:09.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.985+0000 7f79d280b700 1 -- 172.21.15.67:0/3458707955 wait complete. 2023-10-14T11:23:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.987+0000 7f79d280b700 1 Processor -- start 2023-10-14T11:23:09.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.987+0000 7f79d280b700 1 -- start start 2023-10-14T11:23:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.987+0000 7f79d280b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79cc0c52c0 0x7f79cc140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.987+0000 7f79d280b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e4a0 0x7f79cc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc141440 con 0x7f79cc15e0c0 2023-10-14T11:23:09.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc151f90 con 0x7f79cc0c52c0 2023-10-14T11:23:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79cc0b3d70 con 0x7f79cc15e4a0 2023-10-14T11:23:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41778/0 (socket says 172.21.15.67:41778) 2023-10-14T11:23:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 -- 172.21.15.67:0/440424941 learned_addr learned my addr 172.21.15.67:0/440424941 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:10.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cbfff700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79cc0c52c0 0x7f79cc140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d0da8700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e4a0 0x7f79cc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 -- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e4a0 msgr2=0x7f79cc0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e4a0 0x7f79cc0b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 -- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79cc0c52c0 msgr2=0x7f79cc140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79cc0c52c0 0x7f79cc140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 -- 172.21.15.67:0/440424941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4009b30 con 0x7f79cc15e0c0 2023-10-14T11:23:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79cb7fe700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79c000c7f0 tx=0x7f79c000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0011800 con 0x7f79cc15e0c0 2023-10-14T11:23:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c0011960 con 0x7f79cc15e0c0 2023-10-14T11:23:10.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0011cf0 con 0x7f79cc15e0c0 2023-10-14T11:23:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79cc0b4050 con 0x7f79cc15e0c0 2023-10-14T11:23:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.988+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79cc0b3000 con 0x7f79cc15e0c0 2023-10-14T11:23:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.989+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79cc0b4290 con 0x7f79cc15e0c0 2023-10-14T11:23:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.990+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79c0018360 con 0x7f79cc15e0c0 2023-10-14T11:23:10.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.990+0000 7f79c8ff9700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 0x7f79b806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.990+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79c00893f0 con 0x7f79cc15e0c0 2023-10-14T11:23:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.990+0000 7f79cbfff700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 0x7f79b806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.991+0000 7f79cbfff700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 0x7f79b806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009950 tx=0x7f79bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:09.995+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79cc0b4290 con 0x7f79cc15e0c0 2023-10-14T11:23:10.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.242+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79cc0b4290 con 0x7f79cc15e0c0 2023-10-14T11:23:10.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.242+0000 7f79c8ff9700 1 -- 172.21.15.67:0/440424941 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f79cc0b4290 con 0x7f79cc15e0c0 2023-10-14T11:23:10.246 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:10.246 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:10.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 msgr2=0x7f79b806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 0x7f79b806d3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009950 tx=0x7f79bc008040 comp rx=0 tx=0).stop 2023-10-14T11:23:10.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 msgr2=0x7f79cc0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f79c000c7f0 tx=0x7f79c000cb00 comp rx=0 tx=0).stop 2023-10-14T11:23:10.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 shutdown_connections 2023-10-14T11:23:10.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f79cc15e4a0 0x7f79cc0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79cc0c52c0 0x7f79cc140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f79b806af00 0x7f79b806d3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 --2- 172.21.15.67:0/440424941 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f79cc15e0c0 0x7f79cc0b49a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 >> 172.21.15.67:0/440424941 conn(0x7f79cc0d0440 msgr2=0x7f79cc157160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 shutdown_connections 2023-10-14T11:23:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.244+0000 7f79d280b700 1 -- 172.21.15.67:0/440424941 wait complete. 2023-10-14T11:23:10.250 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:10.260 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:10.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.382+0000 7f7644fd3700 1 Processor -- start 2023-10-14T11:23:10.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.382+0000 7f7644fd3700 1 -- start start 2023-10-14T11:23:10.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f7644fd3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f764015da60 0x7f76400c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f7644fd3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76400c5a10 0x7f764006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f7644fd3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400c5e70 con 0x7f764006adc0 2023-10-14T11:23:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f7644fd3700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76401624b0 con 0x7f764015da60 2023-10-14T11:23:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f7644fd3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764015de40 con 0x7f76400c5a10 2023-10-14T11:23:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f764015da60 0x7f76400c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f764015da60 0x7f76400c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41784/0 (socket says 172.21.15.67:41784) 2023-10-14T11:23:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 -- 172.21.15.67:0/932240726 learned_addr learned my addr 172.21.15.67:0/932240726 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763dd9b700 1 --2- 172.21.15.67:0/932240726 >> v2:172.21.15.72:3300/0 conn(0x7f76400c5a10 0x7f764006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 -- 172.21.15.67:0/932240726 >> v2:172.21.15.72:3300/0 conn(0x7f76400c5a10 msgr2=0x7f764006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 --2- 172.21.15.67:0/932240726 >> v2:172.21.15.72:3300/0 conn(0x7f76400c5a10 0x7f764006a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 -- 172.21.15.67:0/932240726 >> v1:172.21.15.72:6789/0 conn(0x7f764006adc0 legacy=0x7f764006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 -- 172.21.15.67:0/932240726 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76401616f0 con 0x7f764015da60 2023-10-14T11:23:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.383+0000 7f763e59c700 1 --2- 172.21.15.67:0/932240726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764015da60 0x7f76400c54d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76400afab0 tx=0x7f7634009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0de7cd23a4a05d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f763d59a700 1 -- 172.21.15.67:0/932240726 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400b870 con 0x7f764015da60 2023-10-14T11:23:10.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f763d59a700 1 -- 172.21.15.67:0/932240726 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400b9d0 con 0x7f764015da60 2023-10-14T11:23:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f763d59a700 1 -- 172.21.15.67:0/932240726 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400bd60 con 0x7f764015da60 2023-10-14T11:23:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 -- 172.21.15.67:0/932240726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764015da60 msgr2=0x7f76400c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 --2- 172.21.15.67:0/932240726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764015da60 0x7f76400c54d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f76400afab0 tx=0x7f7634009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 -- 172.21.15.67:0/932240726 shutdown_connections 2023-10-14T11:23:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 --2- 172.21.15.67:0/932240726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764015da60 0x7f76400c54d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 --2- 172.21.15.67:0/932240726 >> v2:172.21.15.72:3300/0 conn(0x7f76400c5a10 0x7f764006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 -- 172.21.15.67:0/932240726 >> 172.21.15.67:0/932240726 conn(0x7f76400d0440 msgr2=0x7f76400d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 -- 172.21.15.67:0/932240726 shutdown_connections 2023-10-14T11:23:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.384+0000 7f7644fd3700 1 -- 172.21.15.67:0/932240726 wait complete. 2023-10-14T11:23:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 Processor -- start 2023-10-14T11:23:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 -- start start 2023-10-14T11:23:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76400c5a10 0x7f764015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 0x7f764015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b5a20 con 0x7f764006adc0 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400ad2c0 con 0x7f764015da60 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.386+0000 7f7644fd3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400ac990 con 0x7f76400c5a10 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41790/0 (socket says 172.21.15.67:41790) 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 -- 172.21.15.67:0/1859174788 learned_addr learned my addr 172.21.15.67:0/1859174788 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763dd9b700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76400c5a10 0x7f764015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763ed9d700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 0x7f764015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 -- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76400c5a10 msgr2=0x7f764015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76400c5a10 0x7f764015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 -- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 msgr2=0x7f764015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 0x7f764015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 -- 172.21.15.67:0/1859174788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009550 con 0x7f764006adc0 2023-10-14T11:23:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763ed9d700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 0x7f764015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f763e59c700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7634000c00 tx=0x7f7634004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634004540 con 0x7f764006adc0 2023-10-14T11:23:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76340036a0 con 0x7f764006adc0 2023-10-14T11:23:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76400acc70 con 0x7f764006adc0 2023-10-14T11:23:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634003a10 con 0x7f764006adc0 2023-10-14T11:23:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.387+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7640160460 con 0x7f764006adc0 2023-10-14T11:23:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.388+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764004ebb0 con 0x7f764006adc0 2023-10-14T11:23:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.389+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7634021070 con 0x7f764006adc0 2023-10-14T11:23:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.389+0000 7f762effd700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 0x7f762006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.389+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f763408adc0 con 0x7f764006adc0 2023-10-14T11:23:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.389+0000 7f763dd9b700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 0x7f762006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.390+0000 7f763dd9b700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 0x7f762006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f764015fcb0 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.394+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7634055e70 con 0x7f764006adc0 2023-10-14T11:23:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.594+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7640072cc0 con 0x7f764006adc0 2023-10-14T11:23:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.595+0000 7f762effd700 1 -- 172.21.15.67:0/1859174788 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f7634059490 con 0x7f764006adc0 2023-10-14T11:23:10.598 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:10.598 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 msgr2=0x7f762006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 0x7f762006d3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f764015fcb0 tx=0x7f7630008040 comp rx=0 tx=0).stop 2023-10-14T11:23:10.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 msgr2=0x7f764015e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7634000c00 tx=0x7f7634004750 comp rx=0 tx=0).stop 2023-10-14T11:23:10.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 shutdown_connections 2023-10-14T11:23:10.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f764015da60 0x7f764015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f762006af00 0x7f762006d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f764006adc0 0x7f764015e010 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 --2- 172.21.15.67:0/1859174788 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76400c5a10 0x7f764015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 >> 172.21.15.67:0/1859174788 conn(0x7f76400d0440 msgr2=0x7f764015cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 shutdown_connections 2023-10-14T11:23:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.597+0000 7f7644fd3700 1 -- 172.21.15.67:0/1859174788 wait complete. 2023-10-14T11:23:10.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:10.613 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.740+0000 7f6e06713700 1 Processor -- start 2023-10-14T11:23:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.740+0000 7f6e06713700 1 -- start start 2023-10-14T11:23:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e06713700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0006b3b0 0x7f6e000cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e06713700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e06713700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e000b0f90 con 0x7f6e000b0bb0 2023-10-14T11:23:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e06713700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e000cde00 con 0x7f6e0006b3b0 2023-10-14T11:23:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e06713700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000b1c00 con 0x7f6e000b1250 2023-10-14T11:23:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0006b3b0 0x7f6e000cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e04cb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6e0006b3b0 0x7f6e000cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42208/0 (socket says 172.21.15.67:42208) 2023-10-14T11:23:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e04cb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44074/0 (socket says 172.21.15.67:44074) 2023-10-14T11:23:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 -- 172.21.15.67:0/903252062 learned_addr learned my addr 172.21.15.67:0/903252062 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dfffff700 1 --1- 172.21.15.67:0/903252062 >> v1:172.21.15.72:6789/0 conn(0x7f6e000b0bb0 0x7f6e000cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:47914/0 (socket says 172.21.15.67:47914) 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 -- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 msgr2=0x7f6e000b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 -- 172.21.15.67:0/903252062 >> v1:172.21.15.72:6789/0 conn(0x7f6e000b0bb0 legacy=0x7f6e000cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 -- 172.21.15.67:0/903252062 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000cc820 con 0x7f6e0006b3b0 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6e04cb0700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.741+0000 7f6dff7fe700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0006b3b0 0x7f6e000cd8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6df40098f0 tx=0x7f6df4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7675c76c838311 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6dfeffd700 1 -- 172.21.15.67:0/903252062 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4011830 con 0x7f6e0006b3b0 2023-10-14T11:23:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6dfeffd700 1 -- 172.21.15.67:0/903252062 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df4011990 con 0x7f6e0006b3b0 2023-10-14T11:23:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6dfeffd700 1 -- 172.21.15.67:0/903252062 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4011d20 con 0x7f6e0006b3b0 2023-10-14T11:23:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 -- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0006b3b0 msgr2=0x7f6e000cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0006b3b0 0x7f6e000cd8c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6df40098f0 tx=0x7f6df4009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 -- 172.21.15.67:0/903252062 shutdown_connections 2023-10-14T11:23:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e000b1250 0x7f6e000b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 --2- 172.21.15.67:0/903252062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0006b3b0 0x7f6e000cd8c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 -- 172.21.15.67:0/903252062 >> 172.21.15.67:0/903252062 conn(0x7f6e000d04b0 msgr2=0x7f6e000d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 -- 172.21.15.67:0/903252062 shutdown_connections 2023-10-14T11:23:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.742+0000 7f6e06713700 1 -- 172.21.15.67:0/903252062 wait complete. 2023-10-14T11:23:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.743+0000 7f6e06713700 1 Processor -- start 2023-10-14T11:23:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 -- start start 2023-10-14T11:23:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0006b3b0 0x7f6e00160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e000b1250 0x7f6e0006f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000c9ee0 con 0x7f6e000b0bb0 2023-10-14T11:23:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000c92a0 con 0x7f6e000b1250 2023-10-14T11:23:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e06713700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000c9540 con 0x7f6e0006b3b0 2023-10-14T11:23:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6dff7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6dff7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41806/0 (socket says 172.21.15.67:41806) 2023-10-14T11:23:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6dff7fe700 1 -- 172.21.15.67:0/3763172217 learned_addr learned my addr 172.21.15.67:0/3763172217 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6dfffff700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0006b3b0 0x7f6e00160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.744+0000 7f6e04cb0700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e000b1250 0x7f6e0006f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 -- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0006b3b0 msgr2=0x7f6e00160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0006b3b0 0x7f6e00160b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 -- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e000b1250 msgr2=0x7f6e0006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e000b1250 0x7f6e0006f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 -- 172.21.15.67:0/3763172217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df8009a70 con 0x7f6e000b0bb0 2023-10-14T11:23:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dff7fe700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6df4000c00 tx=0x7f6df4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40043c0 con 0x7f6e000b0bb0 2023-10-14T11:23:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df401f070 con 0x7f6e000b0bb0 2023-10-14T11:23:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df4009550 con 0x7f6e000b0bb0 2023-10-14T11:23:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40036a0 con 0x7f6e000b0bb0 2023-10-14T11:23:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.745+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e000c9b00 con 0x7f6e000b0bb0 2023-10-14T11:23:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.746+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e000ca020 con 0x7f6e000b0bb0 2023-10-14T11:23:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.746+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6df4021030 con 0x7f6e000b0bb0 2023-10-14T11:23:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.747+0000 7f6dfcff9700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.747+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6df408a8b0 con 0x7f6e000b0bb0 2023-10-14T11:23:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.747+0000 7f6dfffff700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.748+0000 7f6dfffff700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6df0000f60 tx=0x7f6df0007ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.752+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e000ca020 con 0x7f6e000b0bb0 2023-10-14T11:23:10.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.949+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e000ca020 con 0x7f6e000b0bb0 2023-10-14T11:23:10.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.950+0000 7f6dfcff9700 1 -- 172.21.15.67:0/3763172217 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e000ca020 con 0x7f6e000b0bb0 2023-10-14T11:23:10.953 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 msgr2=0x7f6dec06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6df0000f60 tx=0x7f6df0007ed0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 msgr2=0x7f6e00157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:10.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6df4000c00 tx=0x7f6df4004750 comp rx=0 tx=0).stop 2023-10-14T11:23:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 shutdown_connections 2023-10-14T11:23:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e000b1250 0x7f6e0006f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0006b3b0 0x7f6e00160b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 --2- 172.21.15.67:0/3763172217 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e000b0bb0 0x7f6e00157ae0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 >> 172.21.15.67:0/3763172217 conn(0x7f6e000d04b0 msgr2=0x7f6e0015d780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 shutdown_connections 2023-10-14T11:23:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:10.952+0000 7f6e06713700 1 -- 172.21.15.67:0/3763172217 wait complete. 2023-10-14T11:23:10.967 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.092+0000 7f1750d1f700 1 Processor -- start 2023-10-14T11:23:11.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.092+0000 7f1750d1f700 1 -- start start 2023-10-14T11:23:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f1750d1f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f174c15aa60 0x7f174c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f1750d1f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f174c0cd0d0 0x7f174c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f1750d1f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c0ad3c0 con 0x7f174c15ae40 2023-10-14T11:23:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f1750d1f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0d1300 con 0x7f174c0cd0d0 2023-10-14T11:23:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f1750d1f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0ce8f0 con 0x7f174c15aa60 2023-10-14T11:23:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f174c0cd0d0 0x7f174c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f174c0cd0d0 0x7f174c0cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41816/0 (socket says 172.21.15.67:41816) 2023-10-14T11:23:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 -- 172.21.15.67:0/3372463555 learned_addr learned my addr 172.21.15.67:0/3372463555 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174a59c700 1 --2- 172.21.15.67:0/3372463555 >> v2:172.21.15.72:3300/0 conn(0x7f174c15aa60 0x7f174c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 -- 172.21.15.67:0/3372463555 >> v2:172.21.15.72:3300/0 conn(0x7f174c15aa60 msgr2=0x7f174c0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 --2- 172.21.15.67:0/3372463555 >> v2:172.21.15.72:3300/0 conn(0x7f174c15aa60 0x7f174c0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 -- 172.21.15.67:0/3372463555 >> v1:172.21.15.72:6789/0 conn(0x7f174c15ae40 legacy=0x7f174c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 -- 172.21.15.67:0/3372463555 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0ceb50 con 0x7f174c0cd0d0 2023-10-14T11:23:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.093+0000 7f174ad9d700 1 --2- 172.21.15.67:0/3372463555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0cafc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f174c074470 tx=0x7f174400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d526036790be5d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f174959a700 1 -- 172.21.15.67:0/3372463555 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400e070 con 0x7f174c0cd0d0 2023-10-14T11:23:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f174959a700 1 -- 172.21.15.67:0/3372463555 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400b910 con 0x7f174c0cd0d0 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f174959a700 1 -- 172.21.15.67:0/3372463555 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400bcc0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 -- 172.21.15.67:0/3372463555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 msgr2=0x7f174c0cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 --2- 172.21.15.67:0/3372463555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0cafc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f174c074470 tx=0x7f174400b330 comp rx=0 tx=0).stop 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 -- 172.21.15.67:0/3372463555 shutdown_connections 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 --2- 172.21.15.67:0/3372463555 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0cafc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 --2- 172.21.15.67:0/3372463555 >> v2:172.21.15.72:3300/0 conn(0x7f174c15aa60 0x7f174c0ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 -- 172.21.15.67:0/3372463555 >> 172.21.15.67:0/3372463555 conn(0x7f174c0d04b0 msgr2=0x7f174c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 -- 172.21.15.67:0/3372463555 shutdown_connections 2023-10-14T11:23:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.094+0000 7f1750d1f700 1 -- 172.21.15.67:0/3372463555 wait complete. 2023-10-14T11:23:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 Processor -- start 2023-10-14T11:23:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 -- start start 2023-10-14T11:23:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f174c15aa60 0x7f174c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f174c15ae40 0x7f174c06a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c153ba0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c4780 con 0x7f174c15aa60 2023-10-14T11:23:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f1750d1f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c4a30 con 0x7f174c15ae40 2023-10-14T11:23:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.096+0000 7f174a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41818/0 (socket says 172.21.15.67:41818) 2023-10-14T11:23:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 -- 172.21.15.67:0/167033715 learned_addr learned my addr 172.21.15.67:0/167033715 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174ad9d700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f174c15ae40 0x7f174c06a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1749d9b700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f174c15aa60 0x7f174c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 -- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f174c15ae40 msgr2=0x7f174c06a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f174c15ae40 0x7f174c06a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 -- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f174c15aa60 msgr2=0x7f174c1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f174c15aa60 0x7f174c1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 -- 172.21.15.67:0/167033715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744009b30 con 0x7f174c0cd0d0 2023-10-14T11:23:11.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f174a59c700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f173c00e9b0 tx=0x7f173c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c009710 con 0x7f174c0cd0d0 2023-10-14T11:23:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c00ee50 con 0x7f174c0cd0d0 2023-10-14T11:23:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0c4d10 con 0x7f174c0cd0d0 2023-10-14T11:23:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00ca50 con 0x7f174c0cd0d0 2023-10-14T11:23:11.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.097+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c0c52d0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.098+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c04ebb0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.099+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f173c00cbb0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.099+0000 7f1742ffd700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 0x7f172c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.099+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f173c089570 con 0x7f174c0cd0d0 2023-10-14T11:23:11.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.099+0000 7f1749d9b700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 0x7f172c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.100+0000 7f1749d9b700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 0x7f172c06d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f174c1f6550 tx=0x7f1734009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.104+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f173c0546b0 con 0x7f174c0cd0d0 2023-10-14T11:23:11.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.303+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f174c0b1c30 con 0x7f174c0cd0d0 2023-10-14T11:23:11.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.303+0000 7f1742ffd700 1 -- 172.21.15.67:0/167033715 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f173c00ce60 con 0x7f174c0cd0d0 2023-10-14T11:23:11.307 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:11.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 msgr2=0x7f172c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 0x7f172c06d3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f174c1f6550 tx=0x7f1734009040 comp rx=0 tx=0).stop 2023-10-14T11:23:11.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 msgr2=0x7f174c0c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f173c00e9b0 tx=0x7f173c00ecc0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 shutdown_connections 2023-10-14T11:23:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f174c15ae40 0x7f174c06a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f172c06af00 0x7f172c06d3c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f174c0cd0d0 0x7f174c0c4240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 --2- 172.21.15.67:0/167033715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f174c15aa60 0x7f174c1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.305+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 >> 172.21.15.67:0/167033715 conn(0x7f174c0d04b0 msgr2=0x7f174c0b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:11.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.306+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 shutdown_connections 2023-10-14T11:23:11.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.306+0000 7f1750d1f700 1 -- 172.21.15.67:0/167033715 wait complete. 2023-10-14T11:23:11.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:11.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.445+0000 7f5b511da700 1 Processor -- start 2023-10-14T11:23:11.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.445+0000 7f5b511da700 1 -- start start 2023-10-14T11:23:11.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b511da700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b511da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c15f4d0 0x7f5b4c15f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b511da700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c15fe10 con 0x7f5b4c0b08d0 2023-10-14T11:23:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b511da700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c15bee0 con 0x7f5b4c0b1140 2023-10-14T11:23:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b511da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c15cd20 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4ad9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5b4c0b08d0 0x7f5b4c15c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41120/0 (socket says 172.21.15.67:41120) 2023-10-14T11:23:11.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41828/0 (socket says 172.21.15.67:41828) 2023-10-14T11:23:11.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4ad9d700 1 -- 172.21.15.67:0/998681704 learned_addr learned my addr 172.21.15.67:0/998681704 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:11.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4b59e700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c15f4d0 0x7f5b4c15f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 -- 172.21.15.67:0/998681704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c15f4d0 msgr2=0x7f5b4c15f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:11.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c15f4d0 0x7f5b4c15f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 -- 172.21.15.67:0/998681704 >> v1:172.21.15.67:6789/0 conn(0x7f5b4c0b08d0 legacy=0x7f5b4c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 -- 172.21.15.67:0/998681704 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c0b15d0 con 0x7f5b4c0b1140 2023-10-14T11:23:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b49d9b700 1 -- 172.21.15.67:0/998681704 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885033716 0 0) 0x7f5b4c15fe10 con 0x7f5b4c0b08d0 2023-10-14T11:23:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.446+0000 7f5b4a59c700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009840 tx=0x7f5b3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83143f86405e40bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b49d9b700 1 -- 172.21.15.67:0/998681704 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c011830 con 0x7f5b4c0b1140 2023-10-14T11:23:11.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b49d9b700 1 -- 172.21.15.67:0/998681704 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c011990 con 0x7f5b4c0b1140 2023-10-14T11:23:11.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b49d9b700 1 -- 172.21.15.67:0/998681704 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c011d20 con 0x7f5b4c0b1140 2023-10-14T11:23:11.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 -- 172.21.15.67:0/998681704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c0b1140 msgr2=0x7f5b4c06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009840 tx=0x7f5b3c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:11.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 -- 172.21.15.67:0/998681704 shutdown_connections 2023-10-14T11:23:11.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c15f4d0 0x7f5b4c15f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 --2- 172.21.15.67:0/998681704 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c0b1140 0x7f5b4c06b1e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 -- 172.21.15.67:0/998681704 >> 172.21.15.67:0/998681704 conn(0x7f5b4c0d04b0 msgr2=0x7f5b4c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:11.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 -- 172.21.15.67:0/998681704 shutdown_connections 2023-10-14T11:23:11.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.447+0000 7f5b511da700 1 -- 172.21.15.67:0/998681704 wait complete. 2023-10-14T11:23:11.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.449+0000 7f5b511da700 1 Processor -- start 2023-10-14T11:23:11.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.449+0000 7f5b511da700 1 -- start start 2023-10-14T11:23:11.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 0x7f5b4c1f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c0af650 0x7f5b4c0ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0afad0 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0afdb0 con 0x7f5b4c0b08d0 2023-10-14T11:23:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b511da700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c0b0090 con 0x7f5b4c0af650 2023-10-14T11:23:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41834/0 (socket says 172.21.15.67:41834) 2023-10-14T11:23:11.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b4a59c700 1 -- 172.21.15.67:0/2978828194 learned_addr learned my addr 172.21.15.67:0/2978828194 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:11.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b4b59e700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c0af650 0x7f5b4c0ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.450+0000 7f5b4ad9d700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 0x7f5b4c1f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 -- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c0af650 msgr2=0x7f5b4c0ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c0af650 0x7f5b4c0ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 -- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 msgr2=0x7f5b4c1f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 0x7f5b4c1f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 -- 172.21.15.67:0/2978828194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c0094a0 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4ad9d700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 0x7f5b4c1f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b4a59c700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009fd0 tx=0x7f5b3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0038a0 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c01f070 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c0b4990 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c003c40 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.451+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c0b0370 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.452+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c0ce450 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.452+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b3c026480 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.453+0000 7f5b337fe700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 0x7f5b3806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.453+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b3c021070 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.453+0000 7f5b4ad9d700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 0x7f5b3806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.453+0000 7f5b4ad9d700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 0x7f5b3806d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f60 tx=0x7f5b40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.457+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b3c0560c0 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.660 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.657+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b4c0b4b80 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.661 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.657+0000 7f5b337fe700 1 -- 172.21.15.67:0/2978828194 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b3c0150a0 con 0x7f5b4c15f4d0 2023-10-14T11:23:11.661 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:11.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.659+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 msgr2=0x7f5b3806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.659+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 0x7f5b3806d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b40000f60 tx=0x7f5b40009040 comp rx=0 tx=0).stop 2023-10-14T11:23:11.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.659+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 msgr2=0x7f5b4c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.659+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009fd0 tx=0x7f5b3c004750 comp rx=0 tx=0).stop 2023-10-14T11:23:11.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 shutdown_connections 2023-10-14T11:23:11.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5b4c0af650 0x7f5b4c0ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b4c0b08d0 0x7f5b4c1f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5b3806af00 0x7f5b3806d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.664 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 --2- 172.21.15.67:0/2978828194 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5b4c15f4d0 0x7f5b4c0af110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 >> 172.21.15.67:0/2978828194 conn(0x7f5b4c0d04b0 msgr2=0x7f5b4c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:11.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 shutdown_connections 2023-10-14T11:23:11.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.660+0000 7f5b511da700 1 -- 172.21.15.67:0/2978828194 wait complete. 2023-10-14T11:23:11.675 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:11.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.797+0000 7ff9d768a700 1 Processor -- start 2023-10-14T11:23:11.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.797+0000 7ff9d768a700 1 -- start start 2023-10-14T11:23:11.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d768a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d015e0c0 0x7ff9d0072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d768a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d015e4a0 0x7ff9d00cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d768a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d0072ac0 con 0x7ff9d00c52c0 2023-10-14T11:23:11.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d768a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00cfa80 con 0x7ff9d015e0c0 2023-10-14T11:23:11.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d768a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00cfd60 con 0x7ff9d015e4a0 2023-10-14T11:23:11.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d015e0c0 0x7ff9d0072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff9d015e0c0 0x7ff9d0072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41840/0 (socket says 172.21.15.67:41840) 2023-10-14T11:23:11.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 -- 172.21.15.67:0/1605251648 learned_addr learned my addr 172.21.15.67:0/1605251648 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:11.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d4c25700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d015e4a0 0x7ff9d00cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 -- 172.21.15.67:0/1605251648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d015e4a0 msgr2=0x7ff9d00cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:11.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d015e4a0 0x7ff9d00cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 -- 172.21.15.67:0/1605251648 >> v1:172.21.15.72:6789/0 conn(0x7ff9d00c52c0 legacy=0x7ff9d006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 -- 172.21.15.67:0/1605251648 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d00d0040 con 0x7ff9d015e0c0 2023-10-14T11:23:11.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.798+0000 7ff9d5426700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e0c0 0x7ff9d0072580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098f0 tx=0x7ff9cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60caea8e50b02293 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.805 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9c7fff700 1 -- 172.21.15.67:0/1605251648 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00b8a0 con 0x7ff9d015e0c0 2023-10-14T11:23:11.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9c7fff700 1 -- 172.21.15.67:0/1605251648 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc00ba00 con 0x7ff9d015e0c0 2023-10-14T11:23:11.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9c7fff700 1 -- 172.21.15.67:0/1605251648 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc00bd90 con 0x7ff9d015e0c0 2023-10-14T11:23:11.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 -- 172.21.15.67:0/1605251648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e0c0 msgr2=0x7ff9d0072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e0c0 0x7ff9d0072580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0098f0 tx=0x7ff9cc009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:11.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 -- 172.21.15.67:0/1605251648 shutdown_connections 2023-10-14T11:23:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e0c0 0x7ff9d0072580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 --2- 172.21.15.67:0/1605251648 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d015e4a0 0x7ff9d00cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 -- 172.21.15.67:0/1605251648 >> 172.21.15.67:0/1605251648 conn(0x7ff9d00d0440 msgr2=0x7ff9d00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 -- 172.21.15.67:0/1605251648 shutdown_connections 2023-10-14T11:23:11.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.799+0000 7ff9d768a700 1 -- 172.21.15.67:0/1605251648 wait complete. 2023-10-14T11:23:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.800+0000 7ff9d768a700 1 Processor -- start 2023-10-14T11:23:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.800+0000 7ff9d768a700 1 -- start start 2023-10-14T11:23:11.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d00c52c0 0x7ff9d014c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d015e0c0 0x7ff9d00b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d014c810 con 0x7ff9d015e4a0 2023-10-14T11:23:11.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00c69b0 con 0x7ff9d015e0c0 2023-10-14T11:23:11.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d768a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b4ec0 con 0x7ff9d00c52c0 2023-10-14T11:23:11.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d5c27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d5c27700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41850/0 (socket says 172.21.15.67:41850) 2023-10-14T11:23:11.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d5c27700 1 -- 172.21.15.67:0/911246249 learned_addr learned my addr 172.21.15.67:0/911246249 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:11.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d5426700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d00c52c0 0x7ff9d014c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.801+0000 7ff9d4c25700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d015e0c0 0x7ff9d00b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 -- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d00c52c0 msgr2=0x7ff9d014c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d00c52c0 0x7ff9d014c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 -- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d015e0c0 msgr2=0x7ff9d00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:11.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d015e0c0 0x7ff9d00b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:11.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 -- 172.21.15.67:0/911246249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009550 con 0x7ff9d015e4a0 2023-10-14T11:23:11.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d5c27700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800cc50 tx=0x7ff9c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8003c00 con 0x7ff9d015e4a0 2023-10-14T11:23:11.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8003d60 con 0x7ff9d015e4a0 2023-10-14T11:23:11.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d00b51a0 con 0x7ff9d015e4a0 2023-10-14T11:23:11.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c800aab0 con 0x7ff9d015e4a0 2023-10-14T11:23:11.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.802+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d01f2f20 con 0x7ff9d015e4a0 2023-10-14T11:23:11.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.803+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d004ebb0 con 0x7ff9d015e4a0 2023-10-14T11:23:11.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.803+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff9c800ac10 con 0x7ff9d015e4a0 2023-10-14T11:23:11.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.804+0000 7ff9c5ffb700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 0x7ff9b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:11.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.804+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9c80894b0 con 0x7ff9d015e4a0 2023-10-14T11:23:11.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.804+0000 7ff9d5426700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 0x7ff9b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:11.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.804+0000 7ff9d5426700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 0x7ff9b406d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009c40 tx=0x7ff9cc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:11.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:11.808+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9c80545f0 con 0x7ff9d015e4a0 2023-10-14T11:23:12.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.053+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9d0072cc0 con 0x7ff9d015e4a0 2023-10-14T11:23:12.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.053+0000 7ff9c5ffb700 1 -- 172.21.15.67:0/911246249 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff9c8057c10 con 0x7ff9d015e4a0 2023-10-14T11:23:12.058 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:12.059 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:12.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 msgr2=0x7ff9b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 0x7ff9b406d3c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009c40 tx=0x7ff9cc008030 comp rx=0 tx=0).stop 2023-10-14T11:23:12.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 msgr2=0x7ff9d00cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800cc50 tx=0x7ff9c800cf60 comp rx=0 tx=0).stop 2023-10-14T11:23:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 shutdown_connections 2023-10-14T11:23:12.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff9b406af00 0x7ff9b406d3c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff9d015e4a0 0x7ff9d00cb920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff9d00c52c0 0x7ff9d014c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 --2- 172.21.15.67:0/911246249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9d015e0c0 0x7ff9d00b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 >> 172.21.15.67:0/911246249 conn(0x7ff9d00d0440 msgr2=0x7ff9d015d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:12.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 shutdown_connections 2023-10-14T11:23:12.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.055+0000 7ff9d768a700 1 -- 172.21.15.67:0/911246249 wait complete. 2023-10-14T11:23:12.064 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:12.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:12.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.192+0000 7f7e95c6e700 1 Processor -- start 2023-10-14T11:23:12.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.192+0000 7f7e95c6e700 1 -- start start 2023-10-14T11:23:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e95c6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e90157aa0 0x7f7e900cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e95c6e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e900cba00 0x7f7e9015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e95c6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9006e720 con 0x7f7e9015de10 2023-10-14T11:23:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e95c6e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e900cf200 con 0x7f7e900cba00 2023-10-14T11:23:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e95c6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006ebb0 con 0x7f7e90157aa0 2023-10-14T11:23:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e8effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e900cba00 0x7f7e9015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e8effd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e900cba00 0x7f7e9015d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41854/0 (socket says 172.21.15.67:41854) 2023-10-14T11:23:12.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.193+0000 7f7e8effd700 1 -- 172.21.15.67:0/3995445983 learned_addr learned my addr 172.21.15.67:0/3995445983 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8f7fe700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e90157aa0 0x7f7e900cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8effd700 1 -- 172.21.15.67:0/3995445983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e90157aa0 msgr2=0x7f7e900cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8effd700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e90157aa0 0x7f7e900cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8effd700 1 -- 172.21.15.67:0/3995445983 >> v1:172.21.15.72:6789/0 conn(0x7f7e9015de10 legacy=0x7f7e9015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8effd700 1 -- 172.21.15.67:0/3995445983 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9015e240 con 0x7f7e900cba00 2023-10-14T11:23:12.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8effd700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e900cba00 0x7f7e9015d8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e800098f0 tx=0x7f7e80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fc806024b0e4d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8e7fc700 1 -- 172.21.15.67:0/3995445983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80004230 con 0x7f7e900cba00 2023-10-14T11:23:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8e7fc700 1 -- 172.21.15.67:0/3995445983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80004390 con 0x7f7e900cba00 2023-10-14T11:23:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e8e7fc700 1 -- 172.21.15.67:0/3995445983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800036a0 con 0x7f7e900cba00 2023-10-14T11:23:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e95c6e700 1 -- 172.21.15.67:0/3995445983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e900cba00 msgr2=0x7f7e9015d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e900cba00 0x7f7e9015d8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7e800098f0 tx=0x7f7e80009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.194+0000 7f7e95c6e700 1 -- 172.21.15.67:0/3995445983 shutdown_connections 2023-10-14T11:23:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.195+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e90157aa0 0x7f7e900cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.195+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/3995445983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e900cba00 0x7f7e9015d8d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.195+0000 7f7e95c6e700 1 -- 172.21.15.67:0/3995445983 >> 172.21.15.67:0/3995445983 conn(0x7f7e900b16f0 msgr2=0x7f7e900b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:12.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.195+0000 7f7e95c6e700 1 -- 172.21.15.67:0/3995445983 shutdown_connections 2023-10-14T11:23:12.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.195+0000 7f7e95c6e700 1 -- 172.21.15.67:0/3995445983 wait complete. 2023-10-14T11:23:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.196+0000 7f7e95c6e700 1 Processor -- start 2023-10-14T11:23:12.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.196+0000 7f7e95c6e700 1 -- start start 2023-10-14T11:23:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e900cba00 0x7f7e901f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e9015de10 0x7f7e9006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c6e50 con 0x7f7e90157aa0 2023-10-14T11:23:12.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90156b00 con 0x7f7e9015de10 2023-10-14T11:23:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e901f1ea0 con 0x7f7e900cba00 2023-10-14T11:23:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41860/0 (socket says 172.21.15.67:41860) 2023-10-14T11:23:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 -- 172.21.15.67:0/1592387116 learned_addr learned my addr 172.21.15.67:0/1592387116 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:12.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8f7fe700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e900cba00 0x7f7e901f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8ffff700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e9015de10 0x7f7e9006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 -- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e900cba00 msgr2=0x7f7e901f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e900cba00 0x7f7e901f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 -- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e9015de10 msgr2=0x7f7e9006aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e9015de10 0x7f7e9006aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 -- 172.21.15.67:0/1592387116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e80009550 con 0x7f7e90157aa0 2023-10-14T11:23:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e8effd700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e900722d0 tx=0x7f7e80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80003c00 con 0x7f7e90157aa0 2023-10-14T11:23:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8001f070 con 0x7f7e90157aa0 2023-10-14T11:23:12.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90155f30 con 0x7f7e90157aa0 2023-10-14T11:23:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000b660 con 0x7f7e90157aa0 2023-10-14T11:23:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.197+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e90156790 con 0x7f7e90157aa0 2023-10-14T11:23:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.198+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9006c160 con 0x7f7e90157aa0 2023-10-14T11:23:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.199+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e80021030 con 0x7f7e90157aa0 2023-10-14T11:23:12.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.199+0000 7f7e87fff700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 0x7f7e7006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.200+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e8008ab30 con 0x7f7e90157aa0 2023-10-14T11:23:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.200+0000 7f7e8f7fe700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 0x7f7e7006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.200+0000 7f7e8f7fe700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 0x7f7e7006d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009930 tx=0x7f7e78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.204+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e80055c70 con 0x7f7e90157aa0 2023-10-14T11:23:12.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.407+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9014f0b0 con 0x7f7e90157aa0 2023-10-14T11:23:12.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.408+0000 7f7e87fff700 1 -- 172.21.15.67:0/1592387116 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f7e9014f0b0 con 0x7f7e90157aa0 2023-10-14T11:23:12.411 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:12.411 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:12.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 msgr2=0x7f7e7006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 0x7f7e7006d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009930 tx=0x7f7e78008040 comp rx=0 tx=0).stop 2023-10-14T11:23:12.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 msgr2=0x7f7e901489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7e900722d0 tx=0x7f7e80004750 comp rx=0 tx=0).stop 2023-10-14T11:23:12.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 shutdown_connections 2023-10-14T11:23:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e9015de10 0x7f7e9006aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e900cba00 0x7f7e901f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e7006af30 0x7f7e7006d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 --2- 172.21.15.67:0/1592387116 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e90157aa0 0x7f7e901489b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 >> 172.21.15.67:0/1592387116 conn(0x7f7e900b16f0 msgr2=0x7f7e900b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:12.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 shutdown_connections 2023-10-14T11:23:12.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.410+0000 7f7e95c6e700 1 -- 172.21.15.67:0/1592387116 wait complete. 2023-10-14T11:23:12.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:12.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.547+0000 7f0fe8003700 1 Processor -- start 2023-10-14T11:23:12.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.548+0000 7f0fe8003700 1 -- start start 2023-10-14T11:23:12.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.548+0000 7f0fe8003700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fe006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.548+0000 7f0fe8003700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe015de40 con 0x7f0fe015da60 2023-10-14T11:23:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.548+0000 7f0fe8003700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe01616f0 con 0x7f0fe006adc0 2023-10-14T11:23:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.548+0000 7f0fe8003700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01624b0 con 0x7f0fe00c5be0 2023-10-14T11:23:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe5d9f700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0fe015da60 0x7f0fe00c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41160/0 (socket says 172.21.15.67:41160) 2023-10-14T11:23:12.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/3252414688 learned_addr learned my addr 172.21.15.67:0/3252414688 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe559e700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fe006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752584988 0 0) 0x7f0fe015de40 con 0x7f0fe015da60 2023-10-14T11:23:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fcc0035b0 con 0x7f0fe015da60 2023-10-14T11:23:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1653541120 0 0) 0x7f0fcc0035b0 con 0x7f0fe015da60 2023-10-14T11:23:12.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 msgr2=0x7f0fe006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:12.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fe006a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 >> v1:172.21.15.72:6789/0 conn(0x7f0fe006adc0 legacy=0x7f0fe0071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe01619d0 con 0x7f0fe015da60 2023-10-14T11:23:12.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f0fdc001670 con 0x7f0fe015da60 2023-10-14T11:23:12.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 >> v1:172.21.15.67:6789/0 conn(0x7f0fe015da60 legacy=0x7f0fe00c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fcc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc004d90 0x7f0fcc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01624b0 con 0x7f0fcc003a30 2023-10-14T11:23:12.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc00ba10 con 0x7f0fcc004d90 2023-10-14T11:23:12.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc00bbd0 con 0x7f0fe00c5be0 2023-10-14T11:23:12.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fcc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe559e700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.549+0000 7f0fe65a0700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc004d90 0x7f0fcc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 msgr2=0x7f0fcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c5be0 0x7f0fcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc004d90 msgr2=0x7f0fcc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fcc004d90 0x7f0fcc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/3252414688 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0035b0 con 0x7f0fcc003a30 2023-10-14T11:23:12.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fcc003e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00c2f0 tx=0x7f0fcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e05ba2d3bed8a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00cd70 con 0x7f0fcc003a30 2023-10-14T11:23:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc005960 con 0x7f0fcc003a30 2023-10-14T11:23:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe4d9d700 1 -- 172.21.15.67:0/3252414688 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc005d10 con 0x7f0fcc003a30 2023-10-14T11:23:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe8003700 1 -- 172.21.15.67:0/3252414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 msgr2=0x7f0fcc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe8003700 1 --2- 172.21.15.67:0/3252414688 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fcc003e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00c2f0 tx=0x7f0fcc005880 comp rx=0 tx=0).stop 2023-10-14T11:23:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe65a0700 1 -- 172.21.15.67:0/3252414688 reap_dead start 2023-10-14T11:23:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe8003700 1 -- 172.21.15.67:0/3252414688 shutdown_connections 2023-10-14T11:23:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.550+0000 7f0fe8003700 1 -- 172.21.15.67:0/3252414688 >> 172.21.15.67:0/3252414688 conn(0x7f0fe00d0440 msgr2=0x7f0fe00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.551+0000 7f0fe8003700 1 -- 172.21.15.67:0/3252414688 shutdown_connections 2023-10-14T11:23:12.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.551+0000 7f0fe8003700 1 -- 172.21.15.67:0/3252414688 wait complete. 2023-10-14T11:23:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 Processor -- start 2023-10-14T11:23:12.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 -- start start 2023-10-14T11:23:12.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe00c7510 0x7f0fe00aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c7990 0x7f0fe015f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00b43a0 con 0x7f0fcc003a30 2023-10-14T11:23:12.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00b4680 con 0x7f0fe00c7510 2023-10-14T11:23:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.552+0000 7f0fe8003700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe00b4960 con 0x7f0fe00c7990 2023-10-14T11:23:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41878/0 (socket says 172.21.15.67:41878) 2023-10-14T11:23:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/2610646870 learned_addr learned my addr 172.21.15.67:0/2610646870 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:12.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe65a0700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c7990 0x7f0fe015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe559e700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe00c7510 0x7f0fe00aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c7990 msgr2=0x7f0fe015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c7990 0x7f0fe015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe00c7510 msgr2=0x7f0fe00aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe00c7510 0x7f0fe00aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 -- 172.21.15.67:0/2610646870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe00b4c40 con 0x7f0fcc003a30 2023-10-14T11:23:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe5d9f700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc005830 tx=0x7f0fdc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc005ce0 con 0x7f0fcc003a30 2023-10-14T11:23:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc004870 con 0x7f0fcc003a30 2023-10-14T11:23:12.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe00b4f20 con 0x7f0fcc003a30 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc005ea0 con 0x7f0fcc003a30 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.553+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe00af7b0 con 0x7f0fcc003a30 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.554+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe00b5290 con 0x7f0fcc003a30 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.555+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0fdc004c20 con 0x7f0fcc003a30 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.555+0000 7f0fd27fc700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 0x7f0fc406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:12.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.555+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fdc08aa40 con 0x7f0fcc003a30 2023-10-14T11:23:12.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.555+0000 7f0fe559e700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 0x7f0fc406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:12.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.556+0000 7f0fe559e700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 0x7f0fc406d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fe015d760 tx=0x7f0fd4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:12.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.560+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0fdc08ce60 con 0x7f0fcc003a30 2023-10-14T11:23:12.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.807+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fe004ebb0 con 0x7f0fcc003a30 2023-10-14T11:23:12.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.807+0000 7f0fd27fc700 1 -- 172.21.15.67:0/2610646870 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f0fdc055d60 con 0x7f0fcc003a30 2023-10-14T11:23:12.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:12.811 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.809+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 msgr2=0x7f0fc406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.809+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 0x7f0fc406d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0fe015d760 tx=0x7f0fd4009210 comp rx=0 tx=0).stop 2023-10-14T11:23:12.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 msgr2=0x7f0fe014daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc005830 tx=0x7f0fdc001a00 comp rx=0 tx=0).stop 2023-10-14T11:23:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 shutdown_connections 2023-10-14T11:23:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0fe00c7990 0x7f0fe015f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0fc406af00 0x7f0fc406d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0fcc003a30 0x7f0fe014daf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 --2- 172.21.15.67:0/2610646870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0fe00c7510 0x7f0fe00aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:12.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 >> 172.21.15.67:0/2610646870 conn(0x7f0fe00d0440 msgr2=0x7f0fe00caa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:12.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 shutdown_connections 2023-10-14T11:23:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:12.810+0000 7f0fe8003700 1 -- 172.21.15.67:0/2610646870 wait complete. 2023-10-14T11:23:12.816 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:13.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:22:58.003453+0000', 'modified': '2023-10-14T11:23:01.034884+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.72:6837/3174543054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6836', 'nonce': 3174543054}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 3174543054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T11:23:13.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:23:13.229 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T11:23:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.356+0000 7fbb2abbe700 1 Processor -- start 2023-10-14T11:23:13.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.356+0000 7fbb2abbe700 1 -- start start 2023-10-14T11:23:13.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2abbe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbb24157aa0 0x7fbb240cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2abbe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbb2415dfe0 0x7fbb240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2abbe700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2406e720 con 0x7fbb240cba00 2023-10-14T11:23:13.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2abbe700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240cf200 con 0x7fbb24157aa0 2023-10-14T11:23:13.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2abbe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2406ebb0 con 0x7fbb2415dfe0 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbb24157aa0 0x7fbb240cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb23fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbb240cba00 0x7fbb2415d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41180/0 (socket says 172.21.15.67:41180) 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb23fff700 1 -- 172.21.15.67:0/1827449366 learned_addr learned my addr 172.21.15.67:0/1827449366 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2915b700 1 --2- 172.21.15.67:0/1827449366 >> v2:172.21.15.72:3300/0 conn(0x7fbb2415dfe0 0x7fbb240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 -- 172.21.15.67:0/1827449366 >> v2:172.21.15.72:3300/0 conn(0x7fbb2415dfe0 msgr2=0x7fbb240cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1827449366 >> v2:172.21.15.72:3300/0 conn(0x7fbb2415dfe0 0x7fbb240cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 -- 172.21.15.67:0/1827449366 >> v1:172.21.15.67:6789/0 conn(0x7fbb240cba00 legacy=0x7fbb2415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 -- 172.21.15.67:0/1827449366 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2406db10 con 0x7fbb24157aa0 2023-10-14T11:23:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb237fe700 1 -- 172.21.15.67:0/1827449366 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576056171 0 0) 0x7fbb2406e720 con 0x7fbb240cba00 2023-10-14T11:23:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.357+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1827449366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb24157aa0 0x7fbb240cb4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c6bd0 tx=0x7fbb18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe1d4af871e4fb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb237fe700 1 -- 172.21.15.67:0/1827449366 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011830 con 0x7fbb24157aa0 2023-10-14T11:23:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb237fe700 1 -- 172.21.15.67:0/1827449366 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18011990 con 0x7fbb24157aa0 2023-10-14T11:23:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb237fe700 1 -- 172.21.15.67:0/1827449366 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18011d20 con 0x7fbb24157aa0 2023-10-14T11:23:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 -- 172.21.15.67:0/1827449366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb24157aa0 msgr2=0x7fbb240cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/1827449366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb24157aa0 0x7fbb240cb4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb240c6bd0 tx=0x7fbb18009b20 comp rx=0 tx=0).stop 2023-10-14T11:23:13.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 -- 172.21.15.67:0/1827449366 shutdown_connections 2023-10-14T11:23:13.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/1827449366 >> v2:172.21.15.72:3300/0 conn(0x7fbb2415dfe0 0x7fbb240cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/1827449366 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb24157aa0 0x7fbb240cb4c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 -- 172.21.15.67:0/1827449366 >> 172.21.15.67:0/1827449366 conn(0x7fbb240b16f0 msgr2=0x7fbb240b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 -- 172.21.15.67:0/1827449366 shutdown_connections 2023-10-14T11:23:13.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.358+0000 7fbb2abbe700 1 -- 172.21.15.67:0/1827449366 wait complete. 2023-10-14T11:23:13.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.359+0000 7fbb2abbe700 1 Processor -- start 2023-10-14T11:23:13.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.359+0000 7fbb2abbe700 1 -- start start 2023-10-14T11:23:13.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb24157aa0 0x7fbb240c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 0x7fbb240c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b5770 con 0x7fbb240cba00 2023-10-14T11:23:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b4b60 con 0x7fbb2415dfe0 2023-10-14T11:23:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2abbe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240b4e40 con 0x7fbb24157aa0 2023-10-14T11:23:13.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2895a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2895a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41890/0 (socket says 172.21.15.67:41890) 2023-10-14T11:23:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.360+0000 7fbb2895a700 1 -- 172.21.15.67:0/3607516243 learned_addr learned my addr 172.21.15.67:0/3607516243 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb23fff700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb24157aa0 0x7fbb240c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2915b700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 0x7fbb240c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 -- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb24157aa0 msgr2=0x7fbb240c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb24157aa0 0x7fbb240c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 -- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 msgr2=0x7fbb240c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 0x7fbb240c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 -- 172.21.15.67:0/3607516243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180094a0 con 0x7fbb240cba00 2023-10-14T11:23:13.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2915b700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 0x7fbb240c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000c00 tx=0x7fbb18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb217fa700 1 -- 172.21.15.67:0/3607516243 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180036a0 con 0x7fbb240cba00 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb217fa700 1 -- 172.21.15.67:0/3607516243 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1801f070 con 0x7fbb240cba00 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb240b5120 con 0x7fbb240cba00 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb217fa700 1 -- 172.21.15.67:0/3607516243 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003a20 con 0x7fbb240cba00 2023-10-14T11:23:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.361+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2414a810 con 0x7fbb240cba00 2023-10-14T11:23:13.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.362+0000 7fbb217fa700 1 -- 172.21.15.67:0/3607516243 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbb18003b80 con 0x7fbb240cba00 2023-10-14T11:23:13.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.363+0000 7fbb217fa700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 0x7fbb0806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.363+0000 7fbb217fa700 1 -- 172.21.15.67:0/3607516243 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb18021070 con 0x7fbb240cba00 2023-10-14T11:23:13.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.363+0000 7fbb23fff700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 0x7fbb0806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.364+0000 7fbb23fff700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 0x7fbb0806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b2f90 tx=0x7fbb10007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.365+0000 7fbb36da8b80 1 Processor -- start 2023-10-14T11:23:13.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.365+0000 7fbb36da8b80 1 -- start start 2023-10-14T11:23:13.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b537fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b50b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b481c20 con 0x558b1b530220 2023-10-14T11:23:13.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b466c10 con 0x558b1b535630 2023-10-14T11:23:13.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b1b464530 con 0x558b1b50b010 2023-10-14T11:23:13.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41898/0 (socket says 172.21.15.67:41898) 2023-10-14T11:23:13.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 -- 172.21.15.67:0/3386571198 learned_addr learned my addr 172.21.15.67:0/3386571198 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:13.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb23fff700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b537fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2915b700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b50b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 -- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 msgr2=0x558b1b50b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b50b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 -- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 msgr2=0x558b1b537fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b537fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 -- 172.21.15.67:0/3386571198 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b1b41d3a0 con 0x558b1b530220 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2915b700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b50b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb2895a700 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb180090b0 tx=0x7fbb18059970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791b99322160e492 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb0e7fc700 1 -- 172.21.15.67:0/3386571198 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1805a460 con 0x558b1b530220 2023-10-14T11:23:13.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb0e7fc700 1 -- 172.21.15.67:0/3386571198 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18059d60 con 0x558b1b530220 2023-10-14T11:23:13.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.366+0000 7fbb0e7fc700 1 -- 172.21.15.67:0/3386571198 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1805deb0 con 0x558b1b530220 2023-10-14T11:23:13.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 -- 172.21.15.67:0/3386571198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 msgr2=0x558b1b537a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb180090b0 tx=0x7fbb18059970 comp rx=0 tx=0).stop 2023-10-14T11:23:13.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 -- 172.21.15.67:0/3386571198 shutdown_connections 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b50b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b537a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/3386571198 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b537fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 -- 172.21.15.67:0/3386571198 >> 172.21.15.67:0/3386571198 conn(0x558b1b43ad80 msgr2=0x558b1b555ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 -- 172.21.15.67:0/3386571198 shutdown_connections 2023-10-14T11:23:13.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.367+0000 7fbb36da8b80 1 -- 172.21.15.67:0/3386571198 wait complete. 2023-10-14T11:23:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.368+0000 7fbb36da8b80 1 -- start start 2023-10-14T11:23:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.368+0000 7fbb36da8b80 1 Processor -- start 2023-10-14T11:23:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b52dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b50d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b45fe20 con 0x558b1b530220 2023-10-14T11:23:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b3fc6c0 con 0x558b1b535630 2023-10-14T11:23:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b1b3fc360 con 0x558b1b50b010 2023-10-14T11:23:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 10 client.0 _ll_register_callbacks cb 0x558b1b2597b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:23:13.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41906/0 (socket says 172.21.15.67:41906) 2023-10-14T11:23:13.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 -- 172.21.15.67:0/1283423695 learned_addr learned my addr 172.21.15.67:0/1283423695 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b52dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb2915b700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b50d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 -- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 msgr2=0x558b1b52dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b52dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 -- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 msgr2=0x558b1b50d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b50d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 -- 172.21.15.67:0/1283423695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2414a810 con 0x558b1b530220 2023-10-14T11:23:13.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbb100011e0 tx=0x7fbb10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b76e3f64732471 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb037fe700 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2023-10-14T11:23:13.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10001a10 con 0x558b1b530220 2023-10-14T11:23:13.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb10001b70 con 0x558b1b530220 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b1b5005b0 con 0x558b1b530220 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb10001d30 con 0x558b1b530220 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 10 client.4647 fetch_fsmap learned FSMap version 8 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.369+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558b1b28ad90 con 0x558b1b530220 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558b1b5005b0 con 0x558b1b530220 2023-10-14T11:23:13.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb10020070 con 0x558b1b530220 2023-10-14T11:23:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T11:23:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 10 client.4647 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T11:23:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 20 client.4647 populate_metadata read hostname 'smithi067' 2023-10-14T11:23:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5659c0 0x558b1b565da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 4 client.4647 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:23:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 --> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b1b458e00 con 0x558b1b5659c0 2023-10-14T11:23:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5659c0 0x558b1b565da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb037fe700 10 client.4647 ms_handle_connect on v2:172.21.15.72:6836/3174543054 2023-10-14T11:23:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.370+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5659c0 0x558b1b565da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d8c0cc3b51bf45 server_cookie=63b0d5814e6068ca in_seq=0 out_seq=0 2023-10-14T11:23:13.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb037fe700 1 -- 172.21.15.67:0/1283423695 <== mds.0 v2:172.21.15.72:6836/3174543054 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b1b458e00 con 0x558b1b5659c0 2023-10-14T11:23:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb037fe700 10 client.4647 handle_command_reply: tid=0 2023-10-14T11:23:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 client.4647 shutdown 2023-10-14T11:23:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 msgr2=0x558b1b52e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbb100011e0 tx=0x7fbb10000ed0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 shutdown_connections 2023-10-14T11:23:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b50d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b52dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5659c0 0x558b1b565da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1283423695 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b52e260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb037fe700 0 client.4647 ms_handle_reset on v2:172.21.15.72:6836/3174543054 2023-10-14T11:23:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 >> 172.21.15.67:0/1283423695 conn(0x558b1b43ad80 msgr2=0x558b1b50c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 shutdown_connections 2023-10-14T11:23:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1283423695 wait complete. 2023-10-14T11:23:13.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.371+0000 7fbb36da8b80 20 client.4647 trim_cache size 0 max 16384 2023-10-14T11:23:13.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.389+0000 7fbb36da8b80 1 Processor -- start 2023-10-14T11:23:13.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.389+0000 7fbb36da8b80 1 -- start start 2023-10-14T11:23:13.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b5348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b52c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b2e08d0 con 0x558b1b530220 2023-10-14T11:23:13.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b535480 con 0x558b1b535630 2023-10-14T11:23:13.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b1b537fd0 con 0x558b1b50b010 2023-10-14T11:23:13.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41912/0 (socket says 172.21.15.67:41912) 2023-10-14T11:23:13.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 -- 172.21.15.67:0/36854769 learned_addr learned my addr 172.21.15.67:0/36854769 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:13.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb2895a700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b5348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb2915b700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b52c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 -- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 msgr2=0x558b1b5348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b5348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 -- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 msgr2=0x558b1b52c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b52c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb23fff700 1 -- 172.21.15.67:0/36854769 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b1b273c10 con 0x558b1b530220 2023-10-14T11:23:13.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.390+0000 7fbb2915b700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b52c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:13.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb23fff700 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb100079b0 tx=0x7fbb10020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a927b0a034f01fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb0effd700 1 -- 172.21.15.67:0/36854769 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10001590 con 0x558b1b530220 2023-10-14T11:23:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb0effd700 1 -- 172.21.15.67:0/36854769 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000b040 con 0x558b1b530220 2023-10-14T11:23:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb0effd700 1 -- 172.21.15.67:0/36854769 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10001c30 con 0x558b1b530220 2023-10-14T11:23:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 -- 172.21.15.67:0/36854769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 msgr2=0x558b1b552c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb100079b0 tx=0x7fbb10020000 comp rx=0 tx=0).stop 2023-10-14T11:23:13.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 -- 172.21.15.67:0/36854769 shutdown_connections 2023-10-14T11:23:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b535630 0x558b1b52c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b50b010 0x558b1b5348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/36854769 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b552c60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 -- 172.21.15.67:0/36854769 >> 172.21.15.67:0/36854769 conn(0x558b1b43ad80 msgr2=0x558b1b5747b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 -- 172.21.15.67:0/36854769 shutdown_connections 2023-10-14T11:23:13.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.391+0000 7fbb36da8b80 1 -- 172.21.15.67:0/36854769 wait complete. 2023-10-14T11:23:13.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.392+0000 7fbb36da8b80 1 -- start start 2023-10-14T11:23:13.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.392+0000 7fbb36da8b80 1 Processor -- start 2023-10-14T11:23:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b50b010 0x558b1b5b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b535630 0x558b1b5341b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b54e280 con 0x558b1b530220 2023-10-14T11:23:13.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b1b52bd60 con 0x558b1b50b010 2023-10-14T11:23:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b1b54e030 con 0x558b1b535630 2023-10-14T11:23:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb36da8b80 10 client.0 _ll_register_callbacks cb 0x7fbb10014520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:23:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41920/0 (socket says 172.21.15.67:41920) 2023-10-14T11:23:13.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb2895a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b50b010 0x558b1b5b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 -- 172.21.15.67:0/1678901299 learned_addr learned my addr 172.21.15.67:0/1678901299 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb2915b700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b535630 0x558b1b5341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 -- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b535630 msgr2=0x558b1b5341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b535630 0x558b1b5341b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 -- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b50b010 msgr2=0x558b1b5b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b50b010 0x558b1b5b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 -- 172.21.15.67:0/1678901299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b1b28ad90 con 0x558b1b530220 2023-10-14T11:23:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb23fff700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb10007e40 tx=0x7fbb1000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0055c719fdd8f0d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb037fe700 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2023-10-14T11:23:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.393+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1003e070 con 0x558b1b530220 2023-10-14T11:23:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb10022800 con 0x558b1b530220 2023-10-14T11:23:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb18059d60 con 0x558b1b530220 2023-10-14T11:23:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb10001590 con 0x558b1b530220 2023-10-14T11:23:13.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x558b1b2b1200 con 0x558b1b530220 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18059d60 con 0x558b1b530220 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb100012b0 con 0x558b1b530220 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T11:23:13.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 20 client.4653 populate_metadata read hostname 'smithi067' 2023-10-14T11:23:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5348e0 0x558b1b5b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 4 client.4653 mds_command: new command op to 4273 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:23:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 --> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558b1b458b20 con 0x558b1b5348e0 2023-10-14T11:23:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5348e0 0x558b1b5b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:13.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb037fe700 10 client.4653 ms_handle_connect on v2:172.21.15.72:6836/3174543054 2023-10-14T11:23:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.394+0000 7fbb2895a700 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5348e0 0x558b1b5b9680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24583802a62a20cd server_cookie=ccad8403f4b99798 in_seq=0 out_seq=0 2023-10-14T11:23:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb037fe700 1 -- 172.21.15.67:0/1678901299 <== mds.0 v2:172.21.15.72:6836/3174543054 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x558b1b458b20 con 0x558b1b5348e0 2023-10-14T11:23:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb037fe700 10 client.4653 handle_command_reply: tid=0 2023-10-14T11:23:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 client.4653 shutdown 2023-10-14T11:23:13.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 msgr2=0x558b1b54d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbb10007e40 tx=0x7fbb1000a000 comp rx=0 tx=0).stop 2023-10-14T11:23:13.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 shutdown_connections 2023-10-14T11:23:13.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558b1b535630 0x558b1b5341b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558b1b50b010 0x558b1b5b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.72:6836/3174543054,v1:172.21.15.72:6837/3174543054] conn(0x558b1b5348e0 0x558b1b5b9680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 --2- 172.21.15.67:0/1678901299 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558b1b530220 0x558b1b54d710 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.427 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb037fe700 0 client.4653 ms_handle_reset on v2:172.21.15.72:6836/3174543054 2023-10-14T11:23:13.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 >> 172.21.15.67:0/1678901299 conn(0x558b1b43ad80 msgr2=0x558b1b52d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 shutdown_connections 2023-10-14T11:23:13.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 1 -- 172.21.15.67:0/1678901299 wait complete. 2023-10-14T11:23:13.428 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb36da8b80 20 client.4653 trim_cache size 0 max 16384 2023-10-14T11:23:13.429 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:23:13.429 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "c6e5b03d-6480-4879-8e8f-035e52bef8e2", 2023-10-14T11:23:13.429 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2023-10-14T11:23:13.430 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 4273, 2023-10-14T11:23:13.430 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2023-10-14T11:23:13.430 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2023-10-14T11:23:13.430 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "cephfs", 2023-10-14T11:23:13.430 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 14.783235367, 2023-10-14T11:23:13.431 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 8, 2023-10-14T11:23:13.431 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 21, 2023-10-14T11:23:13.431 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 21, 2023-10-14T11:23:13.431 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 21.632500374999999 2023-10-14T11:23:13.431 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:23:13.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 msgr2=0x7fbb0806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 0x7fbb0806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbb240b2f90 tx=0x7fbb10007c00 comp rx=0 tx=0).stop 2023-10-14T11:23:13.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 msgr2=0x7fbb2414a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:13.433 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.395+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000c00 tx=0x7fbb18004750 comp rx=0 tx=0).stop 2023-10-14T11:23:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 shutdown_connections 2023-10-14T11:23:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbb2415dfe0 0x7fbb240c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbb0806af00 0x7fbb0806d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbb240cba00 0x7fbb2414a2d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.434 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 --2- 172.21.15.67:0/3607516243 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbb24157aa0 0x7fbb240c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 >> 172.21.15.67:0/3607516243 conn(0x7fbb240b16f0 msgr2=0x7fbb240b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 shutdown_connections 2023-10-14T11:23:13.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:13.396+0000 7fbb2abbe700 1 -- 172.21.15.67:0/3607516243 wait complete. 2023-10-14T11:23:13.435 INFO:teuthology.run_tasks:Running task kclient... 2023-10-14T11:23:13.460 INFO:tasks.kclient:Mounting kernel clients... 2023-10-14T11:23:13.461 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T11:23:13.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.462 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:23:13.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.480 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-14T11:23:13.549 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-14T11:23:13.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:23:13.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.551 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:23:13.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.609 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-14T11:23:13.677 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-14T11:23:13.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:23:13.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.679 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:23:13.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T11:23:13.772 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-14T11:23:13.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:23:13.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.774 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:23:13.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:13.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T11:23:13.902 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-14T11:23:13.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:23:13.904 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-14T11:23:13.905 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:23:13.905 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:23:13.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:23:14.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.029+0000 7f0b6e10e700 1 Processor -- start 2023-10-14T11:23:14.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.029+0000 7f0b6e10e700 1 -- start start 2023-10-14T11:23:14.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b68159da0 0x7f0b680ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b680720e0 0x7f0b6815e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b6806a810 0x7f0b6806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6806b1e0 con 0x7f0b6806a810 2023-10-14T11:23:14.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b68072560 con 0x7f0b680720e0 2023-10-14T11:23:14.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b6e10e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68071c50 con 0x7f0b68159da0 2023-10-14T11:23:14.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b6806a810 0x7f0b6806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f0b6806a810 0x7f0b6806aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41930/0 (socket says 172.21.15.67:41930) 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 -- 172.21.15.67:0/1697649196 learned_addr learned my addr 172.21.15.67:0/1697649196 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b677fe700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b68159da0 0x7f0b680ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b66ffd700 1 --2- 172.21.15.67:0/1697649196 >> v2:172.21.15.72:3300/0 conn(0x7f0b680720e0 0x7f0b6815e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 -- 172.21.15.67:0/1697649196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b68159da0 msgr2=0x7f0b680ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b68159da0 0x7f0b680ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 -- 172.21.15.67:0/1697649196 >> v2:172.21.15.72:3300/0 conn(0x7f0b680720e0 msgr2=0x7f0b6815e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:14.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 --2- 172.21.15.67:0/1697649196 >> v2:172.21.15.72:3300/0 conn(0x7f0b680720e0 0x7f0b6815e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.030+0000 7f0b67fff700 1 -- 172.21.15.67:0/1697649196 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6815e910 con 0x7f0b6806a810 2023-10-14T11:23:14.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b67fff700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b6806a810 0x7f0b6806aca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806c3f0 tx=0x7f0b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d9a9495a8be7ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:14.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b667fc700 1 -- 172.21.15.67:0/1697649196 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000e070 con 0x7f0b6806a810 2023-10-14T11:23:14.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b667fc700 1 -- 172.21.15.67:0/1697649196 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000b910 con 0x7f0b6806a810 2023-10-14T11:23:14.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b667fc700 1 -- 172.21.15.67:0/1697649196 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000bcc0 con 0x7f0b6806a810 2023-10-14T11:23:14.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 -- 172.21.15.67:0/1697649196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b6806a810 msgr2=0x7f0b6806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:14.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b6806a810 0x7f0b6806aca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0b6806c3f0 tx=0x7f0b6000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:14.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 -- 172.21.15.67:0/1697649196 shutdown_connections 2023-10-14T11:23:14.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b6806a810 0x7f0b6806aca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/1697649196 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b68159da0 0x7f0b680ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/1697649196 >> v2:172.21.15.72:3300/0 conn(0x7f0b680720e0 0x7f0b6815e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 -- 172.21.15.67:0/1697649196 >> 172.21.15.67:0/1697649196 conn(0x7f0b680b0f60 msgr2=0x7f0b680b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 -- 172.21.15.67:0/1697649196 shutdown_connections 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.031+0000 7f0b6e10e700 1 -- 172.21.15.67:0/1697649196 wait complete. 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.033+0000 7f0b6e10e700 1 Processor -- start 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.033+0000 7f0b6e10e700 1 -- start start 2023-10-14T11:23:14.049 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b6806a810 0x7f0b680ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b68159da0 0x7f0b681f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c8570 con 0x7f0b680720e0 2023-10-14T11:23:14.050 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c6630 con 0x7f0b68159da0 2023-10-14T11:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680c68d0 con 0x7f0b6806a810 2023-10-14T11:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41934/0 (socket says 172.21.15.67:41934) 2023-10-14T11:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 -- 172.21.15.67:0/4213607283 learned_addr learned my addr 172.21.15.67:0/4213607283 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:14.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b67fff700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b68159da0 0x7f0b681f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b677fe700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b6806a810 0x7f0b680ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 -- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b6806a810 msgr2=0x7f0b680ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b6806a810 0x7f0b680ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 -- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b68159da0 msgr2=0x7f0b681f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:14.052 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b68159da0 0x7f0b681f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 -- 172.21.15.67:0/4213607283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009b30 con 0x7f0b680720e0 2023-10-14T11:23:14.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b66ffd700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e930 tx=0x7f0b5000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:14.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50013680 con 0x7f0b680720e0 2023-10-14T11:23:14.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b500137e0 con 0x7f0b680720e0 2023-10-14T11:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50013b70 con 0x7f0b680720e0 2023-10-14T11:23:14.054 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b680c8290 con 0x7f0b680720e0 2023-10-14T11:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.034+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b681f6cd0 con 0x7f0b680720e0 2023-10-14T11:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.035+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b680c80f0 con 0x7f0b680720e0 2023-10-14T11:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.036+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b50013cd0 con 0x7f0b680720e0 2023-10-14T11:23:14.055 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.036+0000 7f0b5ffff700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 0x7f0b4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:14.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.036+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b500894e0 con 0x7f0b680720e0 2023-10-14T11:23:14.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.037+0000 7f0b677fe700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 0x7f0b4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:14.056 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.037+0000 7f0b677fe700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 0x7f0b4806d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009b40 tx=0x7f0b58009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:14.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.041+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b680c80f0 con 0x7f0b680720e0 2023-10-14T11:23:14.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.288+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b680c80f0 con 0x7f0b680720e0 2023-10-14T11:23:14.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.289+0000 7f0b5ffff700 1 -- 172.21.15.67:0/4213607283 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b680c80f0 con 0x7f0b680720e0 2023-10-14T11:23:14.292 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T11:23:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.290+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 msgr2=0x7f0b4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.290+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 0x7f0b4806d3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009b40 tx=0x7f0b58009210 comp rx=0 tx=0).stop 2023-10-14T11:23:14.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.290+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 msgr2=0x7f0b680b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:14.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.290+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e930 tx=0x7f0b5000ec40 comp rx=0 tx=0).stop 2023-10-14T11:23:14.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 shutdown_connections 2023-10-14T11:23:14.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b68159da0 0x7f0b681f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b6806a810 0x7f0b680ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b4806af00 0x7f0b4806d3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 --2- 172.21.15.67:0/4213607283 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b680720e0 0x7f0b680b4a40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:14.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 >> 172.21.15.67:0/4213607283 conn(0x7f0b680b0f60 msgr2=0x7f0b6815c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:14.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 shutdown_connections 2023-10-14T11:23:14.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:14.291+0000 7f0b6e10e700 1 -- 172.21.15.67:0/4213607283 wait complete. 2023-10-14T11:23:14.306 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:23:14.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:23:14.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-14T11:23:14.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:23:14.308 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:23:14.308 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:23:14.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:23:14.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:23:14.309 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:23:14.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.310 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-14T11:23:14.327 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:14.327 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:14.327 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:14.328 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:14.328 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:14.328 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:14.328 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:14.328 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:14.329 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:14.329 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:14.329 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:14.329 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:14.329 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:23:14.330 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:14.330 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T11:23:14.330 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-10-14T11:23:14.330 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::1861:4b53:bc45:a6ac/64 scope link noprefixroute 2023-10-14T11:23:14.330 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:14.331 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T11:23:14.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.332 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:14.332 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:14.332 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add name ceph-brx type bridge 2023-10-14T11:23:14.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr flush dev ceph-brx 2023-10-14T11:23:14.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set ceph-brx up 2023-10-14T11:23:14.333 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T11:23:14.334 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:14.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.501 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:23:14.530 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-14T11:23:14.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.532 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-14T11:23:14.600 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-14T11:23:14.600 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:23:14.600 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:23:14.600 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:23:14.601 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:23:14.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.602 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:14.602 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:14.602 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:23:14.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:23:14.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:23:14.603 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:14.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.880 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:23:14.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.900 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2023-10-14T11:23:14.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:14.956 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:14.957 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:14.957 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:23:14.957 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T11:23:14.958 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:15.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T11:23:15.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.052 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:15.052 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:15.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T11:23:15.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T11:23:15.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T11:23:15.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T11:23:15.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T11:23:15.054 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:15.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.271 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:15.271 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:15.272 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-14T11:23:15.272 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T11:23:15.272 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:15.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:15.376 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:23:15.397 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:23:15.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:15.398 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:23:15.454 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T11:23:15.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:15.551 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:15.552 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:15.677 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:15.677 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:15.677 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:15.677 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:15.678 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:15.678 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:15.678 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:15.678 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:15.748 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:15.749 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:15.749 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:15.749 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:15.749 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:15.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:15.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:15.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:15.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790" 2023-10-14T11:23:15.750 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2023-10-14T11:23:15.751 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c6e5b03d-6480-4879-8e8f-035e52bef8e2" will pass to kernel 2023-10-14T11:23:15.752 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T11:23:15.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.753 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:23:15.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.781 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:15.869 INFO:teuthology.orchestra.run.smithi067.stdout:client4469 2023-10-14T11:23:15.869 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:15.869 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:15.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.888 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:15.976 INFO:teuthology.orchestra.run.smithi067.stdout:client4469 2023-10-14T11:23:15.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:15.977 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:16.024 INFO:teuthology.orchestra.run.smithi067.stdout:client4469 2023-10-14T11:23:16.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.026 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c6e5b03d-6480-4879-8e8f-035e52bef8e2.client4469/status') 2023-10-14T11:23:16.079 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4469 (3)172.21.15.67:0/1376331789 2023-10-14T11:23:16.079 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2023-10-14T11:23:16.080 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2023-10-14T11:23:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2023-10-14T11:23:16.081 INFO:teuthology.orchestra.run.smithi067.stderr:70 bytes copied, 2.758e-05 s, 2.5 MB/s 2023-10-14T11:23:16.081 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-14T11:23:16.082 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:23:16.082 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T11:23:16.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:23:16.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.204+0000 7fe4d899c700 1 Processor -- start 2023-10-14T11:23:16.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.204+0000 7fe4d899c700 1 -- start start 2023-10-14T11:23:16.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d899c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4d40cde50 0x7fe4d415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d899c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d415f030 con 0x7fe4d415d890 2023-10-14T11:23:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d899c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d406d2a0 con 0x7fe4d415dc70 2023-10-14T11:23:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d899c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d406e340 con 0x7fe4d40cde50 2023-10-14T11:23:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d1d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe4d40cde50 0x7fe4d415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:16.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d259c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe4d415d890 0x7fe4d40cd740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41238/0 (socket says 172.21.15.67:41238) 2023-10-14T11:23:16.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.205+0000 7fe4d259c700 1 -- 172.21.15.67:0/3264372354 learned_addr learned my addr 172.21.15.67:0/3264372354 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:16.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d1d9b700 1 -- 172.21.15.67:0/3264372354 >> v1:172.21.15.72:6789/0 conn(0x7fe4d415dc70 legacy=0x7fe4d40cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:16.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d1d9b700 1 -- 172.21.15.67:0/3264372354 >> v1:172.21.15.67:6789/0 conn(0x7fe4d415d890 legacy=0x7fe4d40cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d159a700 1 -- 172.21.15.67:0/3264372354 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894865154 0 0) 0x7fe4c8001110 con 0x7fe4d415d890 2023-10-14T11:23:16.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d1d9b700 1 -- 172.21.15.67:0/3264372354 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d406d580 con 0x7fe4d40cde50 2023-10-14T11:23:16.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d1d9b700 1 --2- 172.21.15.67:0/3264372354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d40cde50 0x7fe4d415eaf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40cfa30 tx=0x7fe4c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b0a36190abe3c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:16.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d159a700 1 -- 172.21.15.67:0/3264372354 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4011830 con 0x7fe4d40cde50 2023-10-14T11:23:16.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d159a700 1 -- 172.21.15.67:0/3264372354 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c4011990 con 0x7fe4d40cde50 2023-10-14T11:23:16.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d159a700 1 -- 172.21.15.67:0/3264372354 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4011d20 con 0x7fe4d40cde50 2023-10-14T11:23:16.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d899c700 1 -- 172.21.15.67:0/3264372354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d40cde50 msgr2=0x7fe4d415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d899c700 1 --2- 172.21.15.67:0/3264372354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d40cde50 0x7fe4d415eaf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4d40cfa30 tx=0x7fe4c4009b20 comp rx=0 tx=0).stop 2023-10-14T11:23:16.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d899c700 1 -- 172.21.15.67:0/3264372354 shutdown_connections 2023-10-14T11:23:16.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.206+0000 7fe4d899c700 1 --2- 172.21.15.67:0/3264372354 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d40cde50 0x7fe4d415eaf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.207+0000 7fe4d899c700 1 -- 172.21.15.67:0/3264372354 >> 172.21.15.67:0/3264372354 conn(0x7fe4d40b16f0 msgr2=0x7fe4d40b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:16.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.207+0000 7fe4d899c700 1 -- 172.21.15.67:0/3264372354 shutdown_connections 2023-10-14T11:23:16.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.207+0000 7fe4d899c700 1 -- 172.21.15.67:0/3264372354 wait complete. 2023-10-14T11:23:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.208+0000 7fe4d899c700 1 Processor -- start 2023-10-14T11:23:16.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.208+0000 7fe4d899c700 1 -- start start 2023-10-14T11:23:16.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d40cde50 0x7fe4d4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:16.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 0x7fe4d40cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:16.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:16.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d4158330 con 0x7fe4d415dc70 2023-10-14T11:23:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415fbe0 con 0x7fe4d40cde50 2023-10-14T11:23:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d899c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d415fec0 con 0x7fe4d415d890 2023-10-14T11:23:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41952/0 (socket says 172.21.15.67:41952) 2023-10-14T11:23:16.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 -- 172.21.15.67:0/566691921 learned_addr learned my addr 172.21.15.67:0/566691921 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d1d9b700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 0x7fe4d40cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d259c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d40cde50 0x7fe4d4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 -- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 msgr2=0x7fe4d40cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 0x7fe4d40cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 -- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d40cde50 msgr2=0x7fe4d4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.209+0000 7fe4d2d9d700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d40cde50 0x7fe4d4157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4d2d9d700 1 -- 172.21.15.67:0/566691921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40094a0 con 0x7fe4d415dc70 2023-10-14T11:23:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4d1d9b700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 0x7fe4d40cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:16.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4d2d9d700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00cc10 tx=0x7fe4cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc00abb0 con 0x7fe4d415dc70 2023-10-14T11:23:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc00ad10 con 0x7fe4d415dc70 2023-10-14T11:23:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d41601a0 con 0x7fe4d415dc70 2023-10-14T11:23:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc012660 con 0x7fe4d415dc70 2023-10-14T11:23:16.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.210+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d4160760 con 0x7fe4d415dc70 2023-10-14T11:23:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.211+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d40cd970 con 0x7fe4d415dc70 2023-10-14T11:23:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.211+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4cc0127c0 con 0x7fe4d415dc70 2023-10-14T11:23:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.212+0000 7fe4c2ffd700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 0x7fe4b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.212+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4cc089d40 con 0x7fe4d415dc70 2023-10-14T11:23:16.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.212+0000 7fe4d259c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 0x7fe4b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:16.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.213+0000 7fe4d259c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 0x7fe4b406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000f60 tx=0x7fe4c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:16.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.217+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4cc054df0 con 0x7fe4d415dc70 2023-10-14T11:23:16.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.461+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4d404ebb0 con 0x7fe4d415dc70 2023-10-14T11:23:16.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.462+0000 7fe4c2ffd700 1 -- 172.21.15.67:0/566691921 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe4cc016070 con 0x7fe4d415dc70 2023-10-14T11:23:16.465 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T11:23:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 msgr2=0x7fe4b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 0x7fe4b406d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000f60 tx=0x7fe4c8009040 comp rx=0 tx=0).stop 2023-10-14T11:23:16.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 msgr2=0x7fe4d4161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00cc10 tx=0x7fe4cc00a060 comp rx=0 tx=0).stop 2023-10-14T11:23:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 shutdown_connections 2023-10-14T11:23:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe4b406af00 0x7fe4b406d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe4d415dc70 0x7fe4d4161290 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4d40cde50 0x7fe4d4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 --2- 172.21.15.67:0/566691921 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe4d415d890 0x7fe4d40cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:16.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 >> 172.21.15.67:0/566691921 conn(0x7fe4d40b16f0 msgr2=0x7fe4d40ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:16.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 shutdown_connections 2023-10-14T11:23:16.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:16.464+0000 7fe4d899c700 1 -- 172.21.15.67:0/566691921 wait complete. 2023-10-14T11:23:16.479 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:23:16.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:23:16.480 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-14T11:23:16.480 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T11:23:16.480 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T11:23:16.481 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:23:16.481 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:23:16.481 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:23:16.481 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T11:23:16.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.483 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-14T11:23:16.501 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:16.501 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:16.501 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:16.501 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.502 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:16.502 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.502 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:16.502 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:16.502 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:16.503 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:16.503 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:16.503 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:16.503 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:23:16.503 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::1861:4b53:bc45:a6ac/64 scope link noprefixroute 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:16.504 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 46:66:b4:f4:41:40 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::58b6:ffff:fe21:1cd9/64 scope link 2023-10-14T11:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.505 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:23:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 46:66:b4:f4:41:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:23:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::4466:b4ff:fef4:4140/64 scope link 2023-10-14T11:23:16.506 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.507 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:23:16.566 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-14T11:23:16.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.569 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-14T11:23:16.628 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-14T11:23:16.628 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:23:16.628 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:23:16.628 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:23:16.629 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:23:16.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.629 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:16.630 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:16.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:23:16.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:23:16.631 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:23:16.631 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:16.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.735 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:23:16.752 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:23:16.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.753 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list-id 2023-10-14T11:23:16.809 INFO:teuthology.orchestra.run.smithi067.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T11:23:16.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.810 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:16.810 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:16.810 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:23:16.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T11:23:16.811 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:16.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.904 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T11:23:16.946 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:16.947 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:16.947 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:16.947 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.948 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:16.948 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.948 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:16.948 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 06:7e:e2:b5:9d:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:23:16.948 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:23:16.949 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.949 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::47e:e2ff:feb5:9de9/64 scope link 2023-10-14T11:23:16.949 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:16.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:16.960 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T11:23:17.040 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:17.041 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:17.041 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:17.041 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:17.041 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:17.042 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:17.042 INFO:teuthology.orchestra.run.smithi067.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:17.042 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 06:7e:e2:b5:9d:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:23:17.042 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:23:17.043 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:17.043 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::47e:e2ff:feb5:9de9/64 scope link 2023-10-14T11:23:17.043 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:17.052 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T11:23:17.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.053 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:17.053 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:17.053 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T11:23:17.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T11:23:17.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T11:23:17.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T11:23:17.055 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T11:23:17.055 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:17.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.313 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:23:17.313 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:23:17.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.1 up 2023-10-14T11:23:17.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T11:23:17.314 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:23:17.423 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:17.423 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T11:23:17.448 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T11:23:17.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:17.449 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T11:23:17.506 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-14T11:23:17.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.507 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:17.592 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:17.615 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:17.615 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:17.615 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:17.616 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 2@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:17.616 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:17.616 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:17.616 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:17.616 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:17.642 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:17.643 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:17.643 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:17.643 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 2@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:17.643 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:17.643 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790" 2023-10-14T11:23:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2023-10-14T11:23:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=c6e5b03d-6480-4879-8e8f-035e52bef8e2" will pass to kernel 2023-10-14T11:23:17.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T11:23:17.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T11:23:17.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.682 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:17.755 INFO:teuthology.orchestra.run.smithi067.stdout:client4671 2023-10-14T11:23:17.756 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:17.756 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:17.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.814 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:17.886 INFO:teuthology.orchestra.run.smithi067.stdout:client4671 2023-10-14T11:23:17.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.887 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:17.960 INFO:teuthology.orchestra.run.smithi067.stdout:client4671 2023-10-14T11:23:17.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:17.961 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c6e5b03d-6480-4879-8e8f-035e52bef8e2.client4671/status') 2023-10-14T11:23:18.040 INFO:teuthology.orchestra.run.smithi067.stdout:instance: client.4671 (3)192.168.0.2:0/3312306471 2023-10-14T11:23:18.041 INFO:teuthology.orchestra.run.smithi067.stdout:blocklisted: false 2023-10-14T11:23:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records in 2023-10-14T11:23:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:0+1 records out 2023-10-14T11:23:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:69 bytes copied, 3.015e-05 s, 2.3 MB/s 2023-10-14T11:23:18.043 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-14T11:23:18.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:23:18.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T11:23:18.043 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:23:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.203+0000 7ff339afe700 1 Processor -- start 2023-10-14T11:23:18.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.203+0000 7ff339afe700 1 -- start start 2023-10-14T11:23:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff339afe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3341610f0 0x7ff3341617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff339afe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff334162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff339afe700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3340ce360 con 0x7ff334161d10 2023-10-14T11:23:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff339afe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3340d00c0 con 0x7ff3341610f0 2023-10-14T11:23:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff339afe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340d03a0 con 0x7ff3340d2330 2023-10-14T11:23:18.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff332ffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff334161d10 0x7ff3340ce840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41254/0 (socket says 172.21.15.67:41254) 2023-10-14T11:23:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff332ffd700 1 -- 172.21.15.67:0/3673624208 learned_addr learned my addr 172.21.15.67:0/3673624208 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff3337fe700 1 --2- 172.21.15.67:0/3673624208 >> v2:172.21.15.72:3300/0 conn(0x7ff3341610f0 0x7ff3341617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.204+0000 7ff333fff700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff334162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333455875 0 0) 0x7ff3340ce360 con 0x7ff334161d10 2023-10-14T11:23:18.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3200035b0 con 0x7ff334161d10 2023-10-14T11:23:18.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734053697 0 0) 0x7ff3200035b0 con 0x7ff334161d10 2023-10-14T11:23:18.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 msgr2=0x7ff334162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:18.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff334162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 >> v2:172.21.15.72:3300/0 conn(0x7ff3341610f0 msgr2=0x7ff3341617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:18.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 --2- 172.21.15.67:0/3673624208 >> v2:172.21.15.72:3300/0 conn(0x7ff3341610f0 0x7ff3341617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3340d0680 con 0x7ff334161d10 2023-10-14T11:23:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7ff31c001670 con 0x7ff334161d10 2023-10-14T11:23:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff333fff700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff334162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 >> v1:172.21.15.67:6789/0 conn(0x7ff334161d10 legacy=0x7ff3340ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320003a00 0x7ff320003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff320004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff320005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340d00c0 con 0x7ff320004850 2023-10-14T11:23:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340d03a0 con 0x7ff320003a00 2023-10-14T11:23:18.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32000ba60 con 0x7ff3340d2330 2023-10-14T11:23:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff320004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff3337fe700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320003a00 0x7ff320003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff333fff700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff320005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 -- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 msgr2=0x7ff320005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:18.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff3340d2330 0x7ff320005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 -- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320003a00 msgr2=0x7ff320003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff320003a00 0x7ff320003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 -- 172.21.15.67:0/3673624208 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009a70 con 0x7ff320004850 2023-10-14T11:23:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.205+0000 7ff332ffd700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff320004cd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c320 tx=0x7ff320005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10a9b797aa394f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:18.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00ce60 con 0x7ff320004850 2023-10-14T11:23:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c005960 con 0x7ff320004850 2023-10-14T11:23:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff3327fc700 1 -- 172.21.15.67:0/3673624208 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c005cf0 con 0x7ff320004850 2023-10-14T11:23:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 -- 172.21.15.67:0/3673624208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 msgr2=0x7ff320004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 --2- 172.21.15.67:0/3673624208 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff320004cd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c320 tx=0x7ff320005880 comp rx=0 tx=0).stop 2023-10-14T11:23:18.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff333fff700 1 -- 172.21.15.67:0/3673624208 reap_dead start 2023-10-14T11:23:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 -- 172.21.15.67:0/3673624208 shutdown_connections 2023-10-14T11:23:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 -- 172.21.15.67:0/3673624208 >> 172.21.15.67:0/3673624208 conn(0x7ff33409cab0 msgr2=0x7ff3340d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 -- 172.21.15.67:0/3673624208 shutdown_connections 2023-10-14T11:23:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.206+0000 7ff339afe700 1 -- 172.21.15.67:0/3673624208 wait complete. 2023-10-14T11:23:18.219 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.207+0000 7ff339afe700 1 Processor -- start 2023-10-14T11:23:18.222 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 -- start start 2023-10-14T11:23:18.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33415d020 0x7ff33415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff334154520 0x7ff334154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f3fc0 con 0x7ff320004850 2023-10-14T11:23:18.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff334154ed0 con 0x7ff334154520 2023-10-14T11:23:18.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.208+0000 7ff339afe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f3440 con 0x7ff33415d020 2023-10-14T11:23:18.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41972/0 (socket says 172.21.15.67:41972) 2023-10-14T11:23:18.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 -- 172.21.15.67:0/2094298918 learned_addr learned my addr 172.21.15.67:0/2094298918 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff332ffd700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33415d020 0x7ff33415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff333fff700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff334154520 0x7ff334154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 -- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33415d020 msgr2=0x7ff33415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33415d020 0x7ff33415d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 -- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff334154520 msgr2=0x7ff334154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff334154520 0x7ff334154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 -- 172.21.15.67:0/2094298918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3341f3720 con 0x7ff320004850 2023-10-14T11:23:18.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff3337fe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff324011a70 tx=0x7ff324011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:18.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324011eb0 con 0x7ff320004850 2023-10-14T11:23:18.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400f940 con 0x7ff320004850 2023-10-14T11:23:18.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3341f3a00 con 0x7ff320004850 2023-10-14T11:23:18.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32400fd10 con 0x7ff320004850 2023-10-14T11:23:18.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.209+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3341f3020 con 0x7ff320004850 2023-10-14T11:23:18.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.210+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3341f3210 con 0x7ff320004850 2023-10-14T11:23:18.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.211+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff324014440 con 0x7ff320004850 2023-10-14T11:23:18.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.211+0000 7ff32bfff700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 0x7ff31406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:18.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.211+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff324089b90 con 0x7ff320004850 2023-10-14T11:23:18.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.211+0000 7ff332ffd700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 0x7ff31406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:18.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.212+0000 7ff332ffd700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 0x7ff31406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff31c008fd0 tx=0x7ff31c00a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:18.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.216+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff324054d80 con 0x7ff320004850 2023-10-14T11:23:18.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.469+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff33404ebb0 con 0x7ff320004850 2023-10-14T11:23:18.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.470+0000 7ff32bfff700 1 -- 172.21.15.67:0/2094298918 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff324022070 con 0x7ff320004850 2023-10-14T11:23:18.473 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T11:23:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 msgr2=0x7ff31406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 0x7ff31406d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff31c008fd0 tx=0x7ff31c00a000 comp rx=0 tx=0).stop 2023-10-14T11:23:18.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 msgr2=0x7ff33415f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:18.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff324011a70 tx=0x7ff324011d80 comp rx=0 tx=0).stop 2023-10-14T11:23:18.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 shutdown_connections 2023-10-14T11:23:18.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff334154520 0x7ff334154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff31406af00 0x7ff31406d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff320004850 0x7ff33415f020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 --2- 172.21.15.67:0/2094298918 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff33415d020 0x7ff33415d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 >> 172.21.15.67:0/2094298918 conn(0x7ff33409cab0 msgr2=0x7ff33406cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 shutdown_connections 2023-10-14T11:23:18.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:18.472+0000 7ff339afe700 1 -- 172.21.15.67:0/2094298918 wait complete. 2023-10-14T11:23:18.487 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:23:18.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:23:18.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T11:23:18.488 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T11:23:18.488 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T11:23:18.488 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:23:18.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:23:18.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:23:18.489 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T11:23:18.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:18.490 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T11:23:18.511 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:18.511 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:18.511 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:18.511 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:18.512 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:18.512 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:18.512 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:18.512 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:18.512 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:18.513 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:18.513 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:18.513 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:18.513 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:23:18.513 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:18.514 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T11:23:18.514 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-10-14T11:23:18.514 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc44:94a8:1101:bbd9/64 scope link noprefixroute 2023-10-14T11:23:18.514 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:18.515 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T11:23:18.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:18.515 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:18.516 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:18.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-10-14T11:23:18.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-10-14T11:23:18.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-10-14T11:23:18.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T11:23:18.517 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:18.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:18.690 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:23:18.719 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T11:23:18.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:18.721 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T11:23:18.796 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T11:23:18.796 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:23:18.796 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:23:18.796 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:23:18.797 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:23:18.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:18.797 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:18.798 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:18.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:23:18.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:23:18.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:23:18.799 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:19.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.107 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:23:19.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.124 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-14T11:23:19.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.181 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:19.182 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:19.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:23:19.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T11:23:19.183 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:19.275 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T11:23:19.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.276 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:19.276 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:19.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T11:23:19.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T11:23:19.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T11:23:19.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T11:23:19.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T11:23:19.278 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:19.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.482 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:19.482 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:19.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-10-14T11:23:19.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T11:23:19.484 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:19.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:19.584 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T11:23:19.604 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T11:23:19.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:19.605 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T11:23:19.660 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-14T11:23:19.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:19.774 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:19.775 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:19.874 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:19.874 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:19.874 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:19.874 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 1@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:19.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:19.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:19.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:19.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:19.907 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:19.907 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:19.907 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:19.908 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 1@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:19.908 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:19.908 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:19.908 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:19.908 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:19.909 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790" 2023-10-14T11:23:19.909 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2023-10-14T11:23:19.909 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c6e5b03d-6480-4879-8e8f-035e52bef8e2" will pass to kernel 2023-10-14T11:23:19.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T11:23:19.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T11:23:19.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:19.955 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:20.026 INFO:teuthology.orchestra.run.smithi072.stdout:client4478 2023-10-14T11:23:20.027 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:20.027 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:20.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.086 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:20.156 INFO:teuthology.orchestra.run.smithi072.stdout:client4478 2023-10-14T11:23:20.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.157 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:20.228 INFO:teuthology.orchestra.run.smithi072.stdout:client4478 2023-10-14T11:23:20.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.229 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c6e5b03d-6480-4879-8e8f-035e52bef8e2.client4478/status') 2023-10-14T11:23:20.308 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4478 (3)192.168.0.1:0/813418919 2023-10-14T11:23:20.309 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2023-10-14T11:23:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2023-10-14T11:23:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2023-10-14T11:23:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:68 bytes copied, 2.2005e-05 s, 3.1 MB/s 2023-10-14T11:23:20.311 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-14T11:23:20.311 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T11:23:20.311 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T11:23:20.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:23:20.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.449+0000 7f4565ba2700 1 Processor -- start 2023-10-14T11:23:20.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 -- start start 2023-10-14T11:23:20.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45600ce9e0 0x7f456015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4560072410 con 0x7f456015a510 2023-10-14T11:23:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600cd000 con 0x7f45600ce9e0 2023-10-14T11:23:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.450+0000 7f4565ba2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456015e710 con 0x7f4560071a80 2023-10-14T11:23:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45600ce9e0 0x7f456015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f456015a510 0x7f45600cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48096/0 (socket says 172.21.15.67:48096) 2023-10-14T11:23:20.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455ffff700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44256/0 (socket says 172.21.15.67:44256) 2023-10-14T11:23:20.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f45600ce9e0 0x7f456015e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42390/0 (socket says 172.21.15.67:42390) 2023-10-14T11:23:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455ffff700 1 -- 172.21.15.67:0/3551419353 learned_addr learned my addr 172.21.15.67:0/3551419353 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 -- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 msgr2=0x7f4560071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 -- 172.21.15.67:0/3551419353 >> v1:172.21.15.72:6789/0 conn(0x7f456015a510 legacy=0x7f45600cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 -- 172.21.15.67:0/3551419353 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456015e970 con 0x7f45600ce9e0 2023-10-14T11:23:20.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455e7fc700 1 -- 172.21.15.67:0/3551419353 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797061453 0 0) 0x7f4560072410 con 0x7f456015a510 2023-10-14T11:23:20.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455ffff700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:20.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455effd700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45600ce9e0 0x7f456015e1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4554009840 tx=0x7f4554009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a6ec6ed93ee3f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:20.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455e7fc700 1 -- 172.21.15.67:0/3551419353 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554011830 con 0x7f45600ce9e0 2023-10-14T11:23:20.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455e7fc700 1 -- 172.21.15.67:0/3551419353 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554011990 con 0x7f45600ce9e0 2023-10-14T11:23:20.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.451+0000 7f455e7fc700 1 -- 172.21.15.67:0/3551419353 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554011d20 con 0x7f45600ce9e0 2023-10-14T11:23:20.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 -- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45600ce9e0 msgr2=0x7f456015e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45600ce9e0 0x7f456015e1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4554009840 tx=0x7f4554009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:20.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 -- 172.21.15.67:0/3551419353 shutdown_connections 2023-10-14T11:23:20.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f4560071a80 0x7f4560071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 --2- 172.21.15.67:0/3551419353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45600ce9e0 0x7f456015e1d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 -- 172.21.15.67:0/3551419353 >> 172.21.15.67:0/3551419353 conn(0x7f45600b0f60 msgr2=0x7f45600b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:20.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 -- 172.21.15.67:0/3551419353 shutdown_connections 2023-10-14T11:23:20.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.452+0000 7f4565ba2700 1 -- 172.21.15.67:0/3551419353 wait complete. 2023-10-14T11:23:20.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.453+0000 7f4565ba2700 1 Processor -- start 2023-10-14T11:23:20.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.453+0000 7f4565ba2700 1 -- start start 2023-10-14T11:23:20.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4560071a80 0x7f456006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f456015a510 0x7f45601f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45601f4a70 con 0x7f45600ce9e0 2023-10-14T11:23:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45601f4d50 con 0x7f4560071a80 2023-10-14T11:23:20.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f4565ba2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45601f5030 con 0x7f456015a510 2023-10-14T11:23:20.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f455effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f455effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:41988/0 (socket says 172.21.15.67:41988) 2023-10-14T11:23:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.454+0000 7f455effd700 1 -- 172.21.15.67:0/1962903641 learned_addr learned my addr 172.21.15.67:0/1962903641 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455ffff700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f456015a510 0x7f45601f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455f7fe700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4560071a80 0x7f456006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 -- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f456015a510 msgr2=0x7f45601f14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f456015a510 0x7f45601f14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 -- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4560071a80 msgr2=0x7f456006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4560071a80 0x7f456006a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 -- 172.21.15.67:0/1962903641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4558009b30 con 0x7f45600ce9e0 2023-10-14T11:23:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f455effd700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4554009fd0 tx=0x7f4554004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:20.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554004550 con 0x7f45600ce9e0 2023-10-14T11:23:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455401f070 con 0x7f45600ce9e0 2023-10-14T11:23:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540038e0 con 0x7f45600ce9e0 2023-10-14T11:23:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45540094a0 con 0x7f45600ce9e0 2023-10-14T11:23:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.455+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45601f0f80 con 0x7f45600ce9e0 2023-10-14T11:23:20.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.456+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600cdc30 con 0x7f45600ce9e0 2023-10-14T11:23:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.457+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4554003a40 con 0x7f45600ce9e0 2023-10-14T11:23:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.457+0000 7f4547fff700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 0x7f454c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.457+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4554021070 con 0x7f45600ce9e0 2023-10-14T11:23:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.457+0000 7f455f7fe700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 0x7f454c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:20.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.458+0000 7f455f7fe700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 0x7f454c06d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4550000f60 tx=0x7f4550007e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:20.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.462+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4554055df0 con 0x7f45600ce9e0 2023-10-14T11:23:20.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.713+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f456004ebb0 con 0x7f45600ce9e0 2023-10-14T11:23:20.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.714+0000 7f4547fff700 1 -- 172.21.15.67:0/1962903641 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f455402b070 con 0x7f45600ce9e0 2023-10-14T11:23:20.717 INFO:teuthology.orchestra.run.smithi067.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-14T11:23:20.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 msgr2=0x7f454c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 0x7f454c06d3c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4550000f60 tx=0x7f4550007e70 comp rx=0 tx=0).stop 2023-10-14T11:23:20.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 msgr2=0x7f456006ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:20.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4554009fd0 tx=0x7f4554004750 comp rx=0 tx=0).stop 2023-10-14T11:23:20.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 shutdown_connections 2023-10-14T11:23:20.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f456015a510 0x7f45601f14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4560071a80 0x7f456006a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f454c06af00 0x7f454c06d3c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 --2- 172.21.15.67:0/1962903641 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f45600ce9e0 0x7f456006ad50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:20.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 >> 172.21.15.67:0/1962903641 conn(0x7f45600b0f60 msgr2=0x7f45600b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:20.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 shutdown_connections 2023-10-14T11:23:20.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:20.716+0000 7f4565ba2700 1 -- 172.21.15.67:0/1962903641 wait complete. 2023-10-14T11:23:20.732 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T11:23:20.732 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:23:20.732 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-10-14T11:23:20.733 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T11:23:20.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T11:23:20.733 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T11:23:20.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T11:23:20.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:23:20.734 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T11:23:20.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.735 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-10-14T11:23:20.754 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.756 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:20.756 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:20.757 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:23:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:20.757 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:23:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T11:23:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-10-14T11:23:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc44:94a8:1101:bbd9/64 scope link noprefixroute 2023-10-14T11:23:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.759 INFO:teuthology.orchestra.run.smithi072.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether a2:f0:1f:70:8c:5c brd ff:ff:ff:ff:ff:ff 2023-10-14T11:23:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:23:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e482:b2ff:fed7:3372/64 scope link 2023-10-14T11:23:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.760 INFO:teuthology.orchestra.run.smithi072.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:23:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether a2:f0:1f:70:8c:5c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:23:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::a0f0:1fff:fe70:8c5c/64 scope link tentative 2023-10-14T11:23:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:20.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.763 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:23:20.821 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-10-14T11:23:20.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.823 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-10-14T11:23:20.882 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-10-14T11:23:20.882 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:23:20.882 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:23:20.883 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:23:20.883 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:23:20.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.884 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:20.884 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:20.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:23:20.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:23:20.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:23:20.885 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:20.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:20.988 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:23:21.004 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T11:23:21.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.006 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-10-14T11:23:21.062 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T11:23:21.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.063 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:21.063 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:21.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:23:21.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T11:23:21.064 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:21.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T11:23:21.191 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:a2:00:ca:b9:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::24a2:ff:feca:b98b/64 scope link 2023-10-14T11:23:21.193 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T11:23:21.284 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:23:21.285 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:23:21.285 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:23:21.285 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.285 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-10-14T11:23:21.286 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.286 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:23:21.286 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 26:a2:00:ca:b9:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T11:23:21.286 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T11:23:21.287 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.287 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::24a2:ff:feca:b98b/64 scope link 2023-10-14T11:23:21.287 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:23:21.297 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T11:23:21.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.298 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:21.298 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:21.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T11:23:21.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T11:23:21.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T11:23:21.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T11:23:21.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T11:23:21.300 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:21.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-10-14T11:23:21.540 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-10-14T11:23:21.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2023-10-14T11:23:21.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T11:23:21.541 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-10-14T11:23:21.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:21.651 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T11:23:21.674 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T11:23:21.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:23:21.675 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T11:23:21.731 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-14T11:23:21.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:21.816 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:21.817 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:21.845 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:21.845 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 3@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:21.846 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:21.847 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:21.921 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:23:21.922 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:23:21.922 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:23:21.922 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 3@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:23:21.922 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:23:21.923 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:23:21.923 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:23:21.923 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:23:21.923 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790" 2023-10-14T11:23:21.924 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2023-10-14T11:23:21.924 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=c6e5b03d-6480-4879-8e8f-035e52bef8e2" will pass to kernel 2023-10-14T11:23:21.925 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-14T11:23:21.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T11:23:21.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:21.952 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:22.024 INFO:teuthology.orchestra.run.smithi072.stdout:client4683 2023-10-14T11:23:22.025 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:22.026 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:22.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:22.085 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:22.154 INFO:teuthology.orchestra.run.smithi072.stdout:client4683 2023-10-14T11:23:22.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:22.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-14T11:23:22.226 INFO:teuthology.orchestra.run.smithi072.stdout:client4683 2023-10-14T11:23:22.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:22.227 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c6e5b03d-6480-4879-8e8f-035e52bef8e2.client4683/status') 2023-10-14T11:23:22.306 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4683 (3)172.21.15.72:0/2731184999 2023-10-14T11:23:22.307 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2023-10-14T11:23:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2023-10-14T11:23:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2023-10-14T11:23:22.308 INFO:teuthology.orchestra.run.smithi072.stderr:70 bytes copied, 2.2734e-05 s, 3.1 MB/s 2023-10-14T11:23:22.309 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T11:23:22.326 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:22.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.462+0000 7f9d3cac3700 1 Processor -- start 2023-10-14T11:23:22.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.462+0000 7f9d3cac3700 1 -- start start 2023-10-14T11:23:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.463+0000 7f9d3cac3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d380c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.463+0000 7f9d3cac3700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3815de40 con 0x7f9d380c5a10 2023-10-14T11:23:22.469 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3cac3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d381616f0 con 0x7f9d3806af90 2023-10-14T11:23:22.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3cac3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3806b3f0 con 0x7f9d3815da60 2023-10-14T11:23:22.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d35d9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f9d380c5a10 0x7f9d3806a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41288/0 (socket says 172.21.15.67:41288) 2023-10-14T11:23:22.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d35d9b700 1 -- 172.21.15.67:0/3837006368 learned_addr learned my addr 172.21.15.67:0/3837006368 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:22.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3659c700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d380c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042924068 0 0) 0x7f9d3815de40 con 0x7f9d380c5a10 2023-10-14T11:23:22.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d240035b0 con 0x7f9d380c5a10 2023-10-14T11:23:22.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009854144 0 0) 0x7f9d240035b0 con 0x7f9d380c5a10 2023-10-14T11:23:22.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 msgr2=0x7f9d380c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:22.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d380c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 >> v1:172.21.15.72:6789/0 conn(0x7f9d3806af90 legacy=0x7f9d38071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d381619d0 con 0x7f9d380c5a10 2023-10-14T11:23:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f9d20001670 con 0x7f9d380c5a10 2023-10-14T11:23:22.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 >> v1:172.21.15.67:6789/0 conn(0x7f9d380c5a10 legacy=0x7f9d3806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d24003a30 0x7f9d24003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d24004d90 0x7f9d24005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3806b3f0 con 0x7f9d24003a30 2023-10-14T11:23:22.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2400ba10 con 0x7f9d24004d90 2023-10-14T11:23:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2400bbd0 con 0x7f9d3815da60 2023-10-14T11:23:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d3659c700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d24003a30 0x7f9d24003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d35d9b700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.464+0000 7f9d36d9d700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d24004d90 0x7f9d24005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 -- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 msgr2=0x7f9d24004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:22.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d3815da60 0x7f9d24004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 -- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d24004d90 msgr2=0x7f9d24005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d24004d90 0x7f9d24005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 -- 172.21.15.67:0/3837006368 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240035b0 con 0x7f9d24003a30 2023-10-14T11:23:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d36d9d700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d24004d90 0x7f9d24005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:22.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3659c700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d24003a30 0x7f9d24003e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009b60 tx=0x7f9d24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d88ae0afa925020 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800e6c0 con 0x7f9d24003a30 2023-10-14T11:23:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2800e820 con 0x7f9d24003a30 2023-10-14T11:23:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.465+0000 7f9d3559a700 1 -- 172.21.15.67:0/3837006368 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800eb90 con 0x7f9d24003a30 2023-10-14T11:23:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 -- 172.21.15.67:0/3837006368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d24003a30 msgr2=0x7f9d24003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/3837006368 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d24003a30 0x7f9d24003e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009b60 tx=0x7f9d24005880 comp rx=0 tx=0).stop 2023-10-14T11:23:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d36d9d700 1 -- 172.21.15.67:0/3837006368 reap_dead start 2023-10-14T11:23:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 -- 172.21.15.67:0/3837006368 shutdown_connections 2023-10-14T11:23:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 -- 172.21.15.67:0/3837006368 >> 172.21.15.67:0/3837006368 conn(0x7f9d380d0440 msgr2=0x7f9d380d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 -- 172.21.15.67:0/3837006368 shutdown_connections 2023-10-14T11:23:22.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.466+0000 7f9d3cac3700 1 -- 172.21.15.67:0/3837006368 wait complete. 2023-10-14T11:23:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.467+0000 7f9d3cac3700 1 Processor -- start 2023-10-14T11:23:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.467+0000 7f9d3cac3700 1 -- start start 2023-10-14T11:23:22.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d24003a30 0x7f9d380af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d3815e5f0 0x7f9d3815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380cb350 con 0x7f9d3815efb0 2023-10-14T11:23:22.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3815f430 con 0x7f9d3815e5f0 2023-10-14T11:23:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3cac3700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380cc170 con 0x7f9d24003a30 2023-10-14T11:23:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42010/0 (socket says 172.21.15.67:42010) 2023-10-14T11:23:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 -- 172.21.15.67:0/1337784388 learned_addr learned my addr 172.21.15.67:0/1337784388 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:22.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d35d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d3815e5f0 0x7f9d3815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d3659c700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d24003a30 0x7f9d380af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 -- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d24003a30 msgr2=0x7f9d380af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d24003a30 0x7f9d380af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 -- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d3815e5f0 msgr2=0x7f9d3815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d3815e5f0 0x7f9d3815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.468+0000 7f9d36d9d700 1 -- 172.21.15.67:0/1337784388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380cb560 con 0x7f9d3815efb0 2023-10-14T11:23:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d36d9d700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d38067640 tx=0x7f9d3000d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000fed0 con 0x7f9d3815efb0 2023-10-14T11:23:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000dcc0 con 0x7f9d3815efb0 2023-10-14T11:23:22.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30003a00 con 0x7f9d3815efb0 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380cb840 con 0x7f9d3815efb0 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.469+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380cbe00 con 0x7f9d3815efb0 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.470+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380cbfc0 con 0x7f9d3815efb0 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.470+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d30003b60 con 0x7f9d3815efb0 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.471+0000 7f9d2effd700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 0x7f9d1806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.471+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d30089810 con 0x7f9d3815efb0 2023-10-14T11:23:22.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.471+0000 7f9d3659c700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 0x7f9d1806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.471+0000 7f9d3659c700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 0x7f9d1806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d280090b0 tx=0x7f9d2801f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.475+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d300548c0 con 0x7f9d3815efb0 2023-10-14T11:23:22.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.680+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d3804ebb0 con 0x7f9d3815efb0 2023-10-14T11:23:22.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.681+0000 7f9d2effd700 1 -- 172.21.15.67:0/1337784388 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f9d30057ee0 con 0x7f9d3815efb0 2023-10-14T11:23:22.685 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:22.685 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.683+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 msgr2=0x7f9d1806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.683+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 0x7f9d1806d3c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d280090b0 tx=0x7f9d2801f040 comp rx=0 tx=0).stop 2023-10-14T11:23:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.683+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 msgr2=0x7f9d3814bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d38067640 tx=0x7f9d3000d660 comp rx=0 tx=0).stop 2023-10-14T11:23:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 shutdown_connections 2023-10-14T11:23:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f9d1806af00 0x7f9d1806d3c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f9d3815efb0 0x7f9d3814bdb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f9d24003a30 0x7f9d380af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 --2- 172.21.15.67:0/1337784388 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d3815e5f0 0x7f9d3815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 >> 172.21.15.67:0/1337784388 conn(0x7f9d380d0440 msgr2=0x7f9d3814e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 shutdown_connections 2023-10-14T11:23:22.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.684+0000 7f9d3cac3700 1 -- 172.21.15.67:0/1337784388 wait complete. 2023-10-14T11:23:22.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:22.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:22.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.826+0000 7f30634f1700 1 Processor -- start 2023-10-14T11:23:22.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.826+0000 7f30634f1700 1 -- start start 2023-10-14T11:23:22.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f30634f1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f305c15de20 0x7f305c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f30634f1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f305c0ce850 0x7f305c15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f30634f1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c15e200 con 0x7f305c06bb20 2023-10-14T11:23:22.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f30634f1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c15f040 con 0x7f305c15de20 2023-10-14T11:23:22.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f30634f1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c15f320 con 0x7f305c0ce850 2023-10-14T11:23:22.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f305c15de20 0x7f305c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f305c15de20 0x7f305c06d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42016/0 (socket says 172.21.15.67:42016) 2023-10-14T11:23:22.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 -- 172.21.15.67:0/2931434740 learned_addr learned my addr 172.21.15.67:0/2931434740 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:22.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f3061a8e700 1 --2- 172.21.15.67:0/2931434740 >> v2:172.21.15.72:3300/0 conn(0x7f305c0ce850 0x7f305c15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 -- 172.21.15.67:0/2931434740 >> v2:172.21.15.72:3300/0 conn(0x7f305c0ce850 msgr2=0x7f305c15e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:22.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 --2- 172.21.15.67:0/2931434740 >> v2:172.21.15.72:3300/0 conn(0x7f305c0ce850 0x7f305c15e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 -- 172.21.15.67:0/2931434740 >> v1:172.21.15.72:6789/0 conn(0x7f305c06bb20 legacy=0x7f305c0cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 -- 172.21.15.67:0/2931434740 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0b2320 con 0x7f305c15de20 2023-10-14T11:23:22.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f306128d700 1 --2- 172.21.15.67:0/2931434740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c15de20 0x7f305c06d3b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f305c066d10 tx=0x7f305800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c511c843122c72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f3053fff700 1 -- 172.21.15.67:0/2931434740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305800dc70 con 0x7f305c15de20 2023-10-14T11:23:22.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f3053fff700 1 -- 172.21.15.67:0/2931434740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305800ddd0 con 0x7f305c15de20 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.827+0000 7f3053fff700 1 -- 172.21.15.67:0/2931434740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058010690 con 0x7f305c15de20 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 -- 172.21.15.67:0/2931434740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c15de20 msgr2=0x7f305c06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 --2- 172.21.15.67:0/2931434740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c15de20 0x7f305c06d3b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f305c066d10 tx=0x7f305800be70 comp rx=0 tx=0).stop 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 -- 172.21.15.67:0/2931434740 shutdown_connections 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 --2- 172.21.15.67:0/2931434740 >> v2:172.21.15.72:3300/0 conn(0x7f305c0ce850 0x7f305c15e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 --2- 172.21.15.67:0/2931434740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c15de20 0x7f305c06d3b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 -- 172.21.15.67:0/2931434740 >> 172.21.15.67:0/2931434740 conn(0x7f305c0b1760 msgr2=0x7f305c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:22.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 -- 172.21.15.67:0/2931434740 shutdown_connections 2023-10-14T11:23:22.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.828+0000 7f30634f1700 1 -- 172.21.15.67:0/2931434740 wait complete. 2023-10-14T11:23:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.829+0000 7f30634f1700 1 Processor -- start 2023-10-14T11:23:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.829+0000 7f30634f1700 1 -- start start 2023-10-14T11:23:22.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f305c06bb20 0x7f305c158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f305c15de20 0x7f305c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0b30b0 con 0x7f305c0ce850 2023-10-14T11:23:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0b3390 con 0x7f305c06bb20 2023-10-14T11:23:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f30634f1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0b3670 con 0x7f305c15de20 2023-10-14T11:23:22.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f3060a8c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f3060a8c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42024/0 (socket says 172.21.15.67:42024) 2023-10-14T11:23:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f3060a8c700 1 -- 172.21.15.67:0/1884059623 learned_addr learned my addr 172.21.15.67:0/1884059623 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:22.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f3061a8e700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f305c15de20 0x7f305c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.830+0000 7f306128d700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f305c06bb20 0x7f305c158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 -- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f305c15de20 msgr2=0x7f305c0b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f305c15de20 0x7f305c0b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 -- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f305c06bb20 msgr2=0x7f305c158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:22.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f305c06bb20 0x7f305c158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:22.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 -- 172.21.15.67:0/1884059623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305800b7f0 con 0x7f305c0ce850 2023-10-14T11:23:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3060a8c700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c450 tx=0x7f304c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0052d0 con 0x7f305c0ce850 2023-10-14T11:23:22.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c005430 con 0x7f305c0ce850 2023-10-14T11:23:22.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c0b3950 con 0x7f305c0ce850 2023-10-14T11:23:22.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0038c0 con 0x7f305c0ce850 2023-10-14T11:23:22.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.831+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c0b3eb0 con 0x7f305c0ce850 2023-10-14T11:23:22.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.832+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c06b940 con 0x7f305c0ce850 2023-10-14T11:23:22.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.833+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f304c003a20 con 0x7f305c0ce850 2023-10-14T11:23:22.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.833+0000 7f3051ffb700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 0x7f304006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:22.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.833+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f304c0888c0 con 0x7f305c0ce850 2023-10-14T11:23:22.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.833+0000 7f306128d700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 0x7f304006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:22.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.834+0000 7f306128d700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 0x7f304006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f305800beb0 tx=0x7f305801c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:22.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:22.837+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f304c053970 con 0x7f305c0ce850 2023-10-14T11:23:23.040 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.037+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f305c04ebb0 con 0x7f305c0ce850 2023-10-14T11:23:23.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.037+0000 7f3051ffb700 1 -- 172.21.15.67:0/1884059623 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f304c0170a0 con 0x7f305c0ce850 2023-10-14T11:23:23.041 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:23.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 msgr2=0x7f304006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 0x7f304006d3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f305800beb0 tx=0x7f305801c040 comp rx=0 tx=0).stop 2023-10-14T11:23:23.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 msgr2=0x7f305c0b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c450 tx=0x7f304c00c760 comp rx=0 tx=0).stop 2023-10-14T11:23:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 shutdown_connections 2023-10-14T11:23:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f305c15de20 0x7f305c0b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f305c06bb20 0x7f305c158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f304006af00 0x7f304006d3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 --2- 172.21.15.67:0/1884059623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f305c0ce850 0x7f305c0b2780 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 >> 172.21.15.67:0/1884059623 conn(0x7f305c0b1760 msgr2=0x7f305c0cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 shutdown_connections 2023-10-14T11:23:23.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.039+0000 7f30634f1700 1 -- 172.21.15.67:0/1884059623 wait complete. 2023-10-14T11:23:23.055 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:23.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.179+0000 7f52306a1700 1 Processor -- start 2023-10-14T11:23:23.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.179+0000 7f52306a1700 1 -- start start 2023-10-14T11:23:23.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f52306a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52280b6f70 0x7f52280cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f52306a1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f522815bbb0 con 0x7f522815b7d0 2023-10-14T11:23:23.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f52306a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52280cf6a0 con 0x7f52280cc0e0 2023-10-14T11:23:23.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f52306a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52280cc560 con 0x7f52280b6f70 2023-10-14T11:23:23.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f522e43d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f522815b7d0 0x7f52280d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41324/0 (socket says 172.21.15.67:41324) 2023-10-14T11:23:23.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.180+0000 7f522e43d700 1 -- 172.21.15.67:0/2758543427 learned_addr learned my addr 172.21.15.67:0/2758543427 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:23.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522dc3c700 1 --2- 172.21.15.67:0/2758543427 >> v2:172.21.15.72:3300/0 conn(0x7f52280b6f70 0x7f52280cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738534451 0 0) 0x7f5224001110 con 0x7f522815b7d0 2023-10-14T11:23:23.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52140035b0 con 0x7f522815b7d0 2023-10-14T11:23:23.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063103468 0 0) 0x7f52140035b0 con 0x7f522815b7d0 2023-10-14T11:23:23.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 >> v2:172.21.15.72:3300/0 conn(0x7f52280b6f70 msgr2=0x7f52280cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:23.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 --2- 172.21.15.67:0/2758543427 >> v2:172.21.15.72:3300/0 conn(0x7f52280b6f70 0x7f52280cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 >> v1:172.21.15.72:6789/0 conn(0x7f52280cc0e0 legacy=0x7f52280b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52280cf980 con 0x7f522815b7d0 2023-10-14T11:23:23.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f5224001800 con 0x7f522815b7d0 2023-10-14T11:23:23.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522dc3c700 1 --2- 172.21.15.67:0/2758543427 >> v2:172.21.15.72:3300/0 conn(0x7f52280b6f70 0x7f52280cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:23.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 >> v1:172.21.15.67:6789/0 conn(0x7f522815b7d0 legacy=0x7f52280d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214003a00 0x7f5214003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214004400 0x7f52140048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 0x7f521400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280cc560 con 0x7f52140050d0 2023-10-14T11:23:23.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521400c030 con 0x7f5214004400 2023-10-14T11:23:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521400c1f0 con 0x7f5214003a00 2023-10-14T11:23:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 0x7f521400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522dc3c700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214004400 0x7f52140048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522e43d700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214003a00 0x7f5214003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 -- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214003a00 msgr2=0x7f5214003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5214003a00 0x7f5214003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 -- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214004400 msgr2=0x7f52140048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5214004400 0x7f52140048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.181+0000 7f522ec3e700 1 -- 172.21.15.67:0/2758543427 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140035b0 con 0x7f52140050d0 2023-10-14T11:23:23.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f522ec3e700 1 -- 172.21.15.67:0/2758543427 reap_dead start 2023-10-14T11:23:23.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f522ec3e700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 0x7f521400ba10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f522000c290 tx=0x7f5214005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c552e35a746529 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220001e70 con 0x7f52140050d0 2023-10-14T11:23:23.196 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522000ce70 con 0x7f52140050d0 2023-10-14T11:23:23.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f522d43b700 1 -- 172.21.15.67:0/2758543427 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003c20 con 0x7f52140050d0 2023-10-14T11:23:23.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 -- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 msgr2=0x7f521400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 0x7f521400ba10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f522000c290 tx=0x7f5214005880 comp rx=0 tx=0).stop 2023-10-14T11:23:23.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 -- 172.21.15.67:0/2758543427 shutdown_connections 2023-10-14T11:23:23.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 --2- 172.21.15.67:0/2758543427 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f52140050d0 0x7f521400ba10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 -- 172.21.15.67:0/2758543427 >> 172.21.15.67:0/2758543427 conn(0x7f52280665a0 msgr2=0x7f5228066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 -- 172.21.15.67:0/2758543427 shutdown_connections 2023-10-14T11:23:23.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.182+0000 7f52306a1700 1 -- 172.21.15.67:0/2758543427 wait complete. 2023-10-14T11:23:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 Processor -- start 2023-10-14T11:23:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 -- start start 2023-10-14T11:23:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140050d0 0x7f522815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52280b24e0 0x7f52280b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280b2ea0 con 0x7f5228148ec0 2023-10-14T11:23:23.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52280c7dd0 con 0x7f52280b24e0 2023-10-14T11:23:23.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.184+0000 7f52306a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522815c5a0 con 0x7f52140050d0 2023-10-14T11:23:23.200 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42044/0 (socket says 172.21.15.67:42044) 2023-10-14T11:23:23.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 -- 172.21.15.67:0/3560718726 learned_addr learned my addr 172.21.15.67:0/3560718726 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522e43d700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140050d0 0x7f522815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522ec3e700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52280b24e0 0x7f52280b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 -- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140050d0 msgr2=0x7f522815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140050d0 0x7f522815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 -- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52280b24e0 msgr2=0x7f52280b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52280b24e0 0x7f52280b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 -- 172.21.15.67:0/3560718726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522815c880 con 0x7f5228148ec0 2023-10-14T11:23:23.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f522dc3c700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5218011ca0 tx=0x7f5218009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218004020 con 0x7f5228148ec0 2023-10-14T11:23:23.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218004180 con 0x7f5228148ec0 2023-10-14T11:23:23.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522815cb60 con 0x7f5228148ec0 2023-10-14T11:23:23.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218004530 con 0x7f5228148ec0 2023-10-14T11:23:23.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.185+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522806bda0 con 0x7f5228148ec0 2023-10-14T11:23:23.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.186+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522806c110 con 0x7f5228148ec0 2023-10-14T11:23:23.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.187+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f521800f940 con 0x7f5228148ec0 2023-10-14T11:23:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.187+0000 7f521effd700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 0x7f520c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.187+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5218089960 con 0x7f5228148ec0 2023-10-14T11:23:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.187+0000 7f522e43d700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 0x7f520c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.188+0000 7f522e43d700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 0x7f520c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5224001e40 tx=0x7f5224001db0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.192+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5218054aa0 con 0x7f5228148ec0 2023-10-14T11:23:23.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.392+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f522806b920 con 0x7f5228148ec0 2023-10-14T11:23:23.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.392+0000 7f521effd700 1 -- 172.21.15.67:0/3560718726 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f522806b920 con 0x7f5228148ec0 2023-10-14T11:23:23.396 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:23.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 msgr2=0x7f520c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 0x7f520c06d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5224001e40 tx=0x7f5224001db0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 msgr2=0x7f522815e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5218011ca0 tx=0x7f5218009e80 comp rx=0 tx=0).stop 2023-10-14T11:23:23.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 shutdown_connections 2023-10-14T11:23:23.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52280b24e0 0x7f52280b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f52140050d0 0x7f522815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f520c06af00 0x7f520c06d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 --2- 172.21.15.67:0/3560718726 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5228148ec0 0x7f522815e5c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 >> 172.21.15.67:0/3560718726 conn(0x7f52280665a0 msgr2=0x7f52280b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 shutdown_connections 2023-10-14T11:23:23.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.395+0000 7f52306a1700 1 -- 172.21.15.67:0/3560718726 wait complete. 2023-10-14T11:23:23.410 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.534+0000 7faf7bf37700 1 Processor -- start 2023-10-14T11:23:23.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.534+0000 7faf7bf37700 1 -- start start 2023-10-14T11:23:23.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7bf37700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf740b0bb0 0x7faf740cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7bf37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 0x7faf740b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7bf37700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf740b0f90 con 0x7faf7406b3b0 2023-10-14T11:23:23.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7bf37700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740cde00 con 0x7faf740b0bb0 2023-10-14T11:23:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7bf37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf740b1c00 con 0x7faf740b1250 2023-10-14T11:23:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf79cd3700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf740b0bb0 0x7faf740cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf794d2700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faf7406b3b0 0x7faf740cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41344/0 (socket says 172.21.15.67:41344) 2023-10-14T11:23:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf794d2700 1 -- 172.21.15.67:0/3535183010 learned_addr learned my addr 172.21.15.67:0/3535183010 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:23.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf7a4d4700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 0x7faf740b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf79cd3700 1 -- 172.21.15.67:0/3535183010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 msgr2=0x7faf740b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:23.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf79cd3700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 0x7faf740b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.535+0000 7faf79cd3700 1 -- 172.21.15.67:0/3535183010 >> v1:172.21.15.67:6789/0 conn(0x7faf7406b3b0 legacy=0x7faf740cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf79cd3700 1 -- 172.21.15.67:0/3535183010 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf740cc820 con 0x7faf740b0bb0 2023-10-14T11:23:23.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7a4d4700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 0x7faf740b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:23.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf79cd3700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b0bb0 0x7faf740cd8c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf70009840 tx=0x7faf70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4467cb26e32cd54 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf78cd1700 1 -- 172.21.15.67:0/3535183010 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70011830 con 0x7faf740b0bb0 2023-10-14T11:23:23.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf78cd1700 1 -- 172.21.15.67:0/3535183010 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf70011990 con 0x7faf740b0bb0 2023-10-14T11:23:23.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf78cd1700 1 -- 172.21.15.67:0/3535183010 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70011d20 con 0x7faf740b0bb0 2023-10-14T11:23:23.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 -- 172.21.15.67:0/3535183010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b0bb0 msgr2=0x7faf740cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b0bb0 0x7faf740cd8c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf70009840 tx=0x7faf70009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 -- 172.21.15.67:0/3535183010 shutdown_connections 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b1250 0x7faf740b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 --2- 172.21.15.67:0/3535183010 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b0bb0 0x7faf740cd8c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.536+0000 7faf7bf37700 1 -- 172.21.15.67:0/3535183010 >> 172.21.15.67:0/3535183010 conn(0x7faf740d04b0 msgr2=0x7faf740d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.537+0000 7faf7bf37700 1 -- 172.21.15.67:0/3535183010 shutdown_connections 2023-10-14T11:23:23.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.537+0000 7faf7bf37700 1 -- 172.21.15.67:0/3535183010 wait complete. 2023-10-14T11:23:23.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 Processor -- start 2023-10-14T11:23:23.547 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 -- start start 2023-10-14T11:23:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406b3b0 0x7faf7415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b0bb0 0x7faf7415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7415a8b0 con 0x7faf740b1250 2023-10-14T11:23:23.548 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf740c6b90 con 0x7faf7406b3b0 2023-10-14T11:23:23.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.538+0000 7faf7bf37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7415ab60 con 0x7faf740b0bb0 2023-10-14T11:23:23.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42060/0 (socket says 172.21.15.67:42060) 2023-10-14T11:23:23.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 -- 172.21.15.67:0/2099807001 learned_addr learned my addr 172.21.15.67:0/2099807001 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:23.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf79cd3700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406b3b0 0x7faf7415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf794d2700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b0bb0 0x7faf7415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 -- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b0bb0 msgr2=0x7faf7415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b0bb0 0x7faf7415a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 -- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406b3b0 msgr2=0x7faf7415f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.550 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406b3b0 0x7faf7415f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 -- 172.21.15.67:0/2099807001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf700094a0 con 0x7faf740b1250 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7a4d4700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00cd50 tx=0x7faf6c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00cea0 con 0x7faf740b1250 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00f480 con 0x7faf740b1250 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf740c85c0 con 0x7faf740b1250 2023-10-14T11:23:23.551 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00f830 con 0x7faf740b1250 2023-10-14T11:23:23.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.539+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf740c8b80 con 0x7faf740b1250 2023-10-14T11:23:23.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.540+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7415ad10 con 0x7faf740b1250 2023-10-14T11:23:23.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.541+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf6c00b040 con 0x7faf740b1250 2023-10-14T11:23:23.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.541+0000 7faf667fc700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 0x7faf5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.541+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf6c089b80 con 0x7faf740b1250 2023-10-14T11:23:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.541+0000 7faf79cd3700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 0x7faf5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.542+0000 7faf79cd3700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 0x7faf5806d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf700090b0 tx=0x7faf70008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.546+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf7415ad10 con 0x7faf740b1250 2023-10-14T11:23:23.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.747+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf7415acd0 con 0x7faf740b1250 2023-10-14T11:23:23.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.747+0000 7faf667fc700 1 -- 172.21.15.67:0/2099807001 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf6c054cc0 con 0x7faf740b1250 2023-10-14T11:23:23.751 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:23.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 msgr2=0x7faf5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 0x7faf5806d3c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faf700090b0 tx=0x7faf70008030 comp rx=0 tx=0).stop 2023-10-14T11:23:23.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 msgr2=0x7faf740c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00cd50 tx=0x7faf6c00a560 comp rx=0 tx=0).stop 2023-10-14T11:23:23.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 shutdown_connections 2023-10-14T11:23:23.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf5806af00 0x7faf5806d3c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf740b1250 0x7faf740c7be0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7406b3b0 0x7faf7415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 --2- 172.21.15.67:0/2099807001 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf740b0bb0 0x7faf7415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 >> 172.21.15.67:0/2099807001 conn(0x7faf740d04b0 msgr2=0x7faf7415da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 shutdown_connections 2023-10-14T11:23:23.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.749+0000 7faf7bf37700 1 -- 172.21.15.67:0/2099807001 wait complete. 2023-10-14T11:23:23.765 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.887+0000 7f5d7c9af700 1 Processor -- start 2023-10-14T11:23:23.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.887+0000 7f5d7c9af700 1 -- start start 2023-10-14T11:23:23.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7c9af700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7c9af700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d780cf720 con 0x7f5d780ce960 2023-10-14T11:23:23.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7c9af700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7806d0b0 con 0x7f5d7815a600 2023-10-14T11:23:23.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7c9af700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7806d390 con 0x7f5d780cc1f0 2023-10-14T11:23:23.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d76d9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5d780ce960 0x7f5d780b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41362/0 (socket says 172.21.15.67:41362) 2023-10-14T11:23:23.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d76d9d700 1 -- 172.21.15.67:0/4048185003 learned_addr learned my addr 172.21.15.67:0/4048185003 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:23.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d75d9b700 1 --2- 172.21.15.67:0/4048185003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215767001 0 0) 0x7f5d780cf720 con 0x7f5d780ce960 2023-10-14T11:23:23.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d600035b0 con 0x7f5d780ce960 2023-10-14T11:23:23.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980524609 0 0) 0x7f5d7806d0b0 con 0x7f5d7815a600 2023-10-14T11:23:23.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d780cf720 con 0x7f5d7815a600 2023-10-14T11:23:23.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d75d9b700 1 -- 172.21.15.67:0/4048185003 >> v1:172.21.15.72:6789/0 conn(0x7f5d7815a600 legacy=0x7f5d7806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d75d9b700 1 -- 172.21.15.67:0/4048185003 >> v1:172.21.15.67:6789/0 conn(0x7f5d780ce960 legacy=0x7f5d780b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d75d9b700 1 -- 172.21.15.67:0/4048185003 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7806d670 con 0x7f5d780cc1f0 2023-10-14T11:23:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.888+0000 7f5d75d9b700 1 --2- 172.21.15.67:0/4048185003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780cb200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4e6b24ef7f9871 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011830 con 0x7f5d780cc1f0 2023-10-14T11:23:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c011990 con 0x7f5d780cc1f0 2023-10-14T11:23:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7559a700 1 -- 172.21.15.67:0/4048185003 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c011d20 con 0x7f5d780cc1f0 2023-10-14T11:23:23.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 -- 172.21.15.67:0/4048185003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 msgr2=0x7f5d780cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/4048185003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780cb200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009870 tx=0x7f5d6c009b80 comp rx=0 tx=0).stop 2023-10-14T11:23:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 -- 172.21.15.67:0/4048185003 shutdown_connections 2023-10-14T11:23:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/4048185003 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780cb200 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 -- 172.21.15.67:0/4048185003 >> 172.21.15.67:0/4048185003 conn(0x7f5d780b16f0 msgr2=0x7f5d780b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:23.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 -- 172.21.15.67:0/4048185003 shutdown_connections 2023-10-14T11:23:23.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.889+0000 7f5d7c9af700 1 -- 172.21.15.67:0/4048185003 wait complete. 2023-10-14T11:23:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 Processor -- start 2023-10-14T11:23:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 -- start start 2023-10-14T11:23:23.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d780ce960 0x7f5d780afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781f3990 con 0x7f5d7815a600 2023-10-14T11:23:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c90a0 con 0x7f5d780ce960 2023-10-14T11:23:23.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.891+0000 7f5d7c9af700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d780c9380 con 0x7f5d780cc1f0 2023-10-14T11:23:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42074/0 (socket says 172.21.15.67:42074) 2023-10-14T11:23:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 -- 172.21.15.67:0/3118305120 learned_addr learned my addr 172.21.15.67:0/3118305120 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d7659c700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d75d9b700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d780ce960 0x7f5d780afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 -- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 msgr2=0x7f5d780b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 -- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d780ce960 msgr2=0x7f5d780afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d780ce960 0x7f5d780afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:23.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 -- 172.21.15.67:0/3118305120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0094a0 con 0x7f5d7815a600 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d76d9d700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000cb40 tx=0x7f5d7000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000a9e0 con 0x7f5d7815a600 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7000ab40 con 0x7f5d7815a600 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d781f3be0 con 0x7f5d7815a600 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d70012400 con 0x7f5d7815a600 2023-10-14T11:23:23.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.892+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d780b37d0 con 0x7f5d7815a600 2023-10-14T11:23:23.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.893+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d781f3e20 con 0x7f5d7815a600 2023-10-14T11:23:23.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.894+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5d7001b3b0 con 0x7f5d7815a600 2023-10-14T11:23:23.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.894+0000 7f5d66ffd700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 0x7f5d5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:23.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.894+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d70089260 con 0x7f5d7815a600 2023-10-14T11:23:23.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.894+0000 7f5d7659c700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 0x7f5d5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:23.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.895+0000 7f5d7659c700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 0x7f5d5806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d680011e0 tx=0x7f5d68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:23.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:23.899+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5d781f3e20 con 0x7f5d7815a600 2023-10-14T11:23:24.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.099+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d781f3e20 con 0x7f5d7815a600 2023-10-14T11:23:24.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.100+0000 7f5d66ffd700 1 -- 172.21.15.67:0/3118305120 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f5d781f3e20 con 0x7f5d7815a600 2023-10-14T11:23:24.104 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:24.104 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:24.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 msgr2=0x7f5d5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 0x7f5d5806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5d680011e0 tx=0x7f5d68009040 comp rx=0 tx=0).stop 2023-10-14T11:23:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 msgr2=0x7f5d780b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000cb40 tx=0x7f5d7000ce50 comp rx=0 tx=0).stop 2023-10-14T11:23:24.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 shutdown_connections 2023-10-14T11:23:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5d5806af00 0x7f5d5806d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5d7815a600 0x7f5d780b0110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5d780cc1f0 0x7f5d780b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 --2- 172.21.15.67:0/3118305120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d780ce960 0x7f5d780afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 >> 172.21.15.67:0/3118305120 conn(0x7f5d780b16f0 msgr2=0x7f5d780cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 shutdown_connections 2023-10-14T11:23:24.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.102+0000 7f5d7c9af700 1 -- 172.21.15.67:0/3118305120 wait complete. 2023-10-14T11:23:24.118 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:24.119 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:24.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.243+0000 7f56fe105700 1 Processor -- start 2023-10-14T11:23:24.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.243+0000 7f56fe105700 1 -- start start 2023-10-14T11:23:24.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56fe105700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f56f80cbdc0 0x7f56f80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56fe105700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80667b0 con 0x7f56f8072360 2023-10-14T11:23:24.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56fe105700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f80b2280 con 0x7f56f815d920 2023-10-14T11:23:24.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56fe105700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f80ca9d0 con 0x7f56f80cbdc0 2023-10-14T11:23:24.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56f7fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f56f8072360 0x7f56f8161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41376/0 (socket says 172.21.15.67:41376) 2023-10-14T11:23:24.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56f7fff700 1 -- 172.21.15.67:0/1890353032 learned_addr learned my addr 172.21.15.67:0/1890353032 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:24.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.244+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/1890353032 >> v2:172.21.15.72:3300/0 conn(0x7f56f80cbdc0 0x7f56f80cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902338947 0 0) 0x7f56f80667b0 con 0x7f56f8072360 2023-10-14T11:23:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56e40035b0 con 0x7f56f8072360 2023-10-14T11:23:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f6ffd700 1 -- 172.21.15.67:0/1890353032 >> v1:172.21.15.72:6789/0 conn(0x7f56f815d920 legacy=0x7f56f80ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132254048 0 0) 0x7f56e40035b0 con 0x7f56f8072360 2023-10-14T11:23:24.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f6ffd700 1 -- 172.21.15.67:0/1890353032 >> v1:172.21.15.67:6789/0 conn(0x7f56f8072360 legacy=0x7f56f8161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f6ffd700 1 -- 172.21.15.67:0/1890353032 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f81616d0 con 0x7f56f80cbdc0 2023-10-14T11:23:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/1890353032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80cbdc0 0x7f56f80cee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009840 tx=0x7f56e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c52ee011fc7452 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f00019f0 con 0x7f56f80cbdc0 2023-10-14T11:23:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0004030 con 0x7f56f80cbdc0 2023-10-14T11:23:24.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.245+0000 7f56f67fc700 1 -- 172.21.15.67:0/1890353032 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e00043c0 con 0x7f56f80cbdc0 2023-10-14T11:23:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 -- 172.21.15.67:0/1890353032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80cbdc0 msgr2=0x7f56f80cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 --2- 172.21.15.67:0/1890353032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80cbdc0 0x7f56f80cee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009840 tx=0x7f56e0009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 -- 172.21.15.67:0/1890353032 shutdown_connections 2023-10-14T11:23:24.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 --2- 172.21.15.67:0/1890353032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f80cbdc0 0x7f56f80cee00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 -- 172.21.15.67:0/1890353032 >> 172.21.15.67:0/1890353032 conn(0x7f56f80b1760 msgr2=0x7f56f80b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 -- 172.21.15.67:0/1890353032 shutdown_connections 2023-10-14T11:23:24.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.246+0000 7f56fe105700 1 -- 172.21.15.67:0/1890353032 wait complete. 2023-10-14T11:23:24.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.247+0000 7f56fe105700 1 Processor -- start 2023-10-14T11:23:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.247+0000 7f56fe105700 1 -- start start 2023-10-14T11:23:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 0x7f56f81f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81f3310 0x7f56f81531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80c9bb0 con 0x7f56f8072360 2023-10-14T11:23:24.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80b3d40 con 0x7f56f815d920 2023-10-14T11:23:24.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56fe105700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80b4020 con 0x7f56f81f3310 2023-10-14T11:23:24.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42086/0 (socket says 172.21.15.67:42086) 2023-10-14T11:23:24.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 -- 172.21.15.67:0/3210615654 learned_addr learned my addr 172.21.15.67:0/3210615654 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:24.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f7fff700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81f3310 0x7f56f81531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 0x7f56f81f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 -- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81f3310 msgr2=0x7f56f81531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81f3310 0x7f56f81531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 -- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 msgr2=0x7f56f81f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 0x7f56f81f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f77fe700 1 -- 172.21.15.67:0/3210615654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e00094a0 con 0x7f56f8072360 2023-10-14T11:23:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.248+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 0x7f56f81f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:24.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56f77fe700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56e800c450 tx=0x7f56e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80052d0 con 0x7f56f8072360 2023-10-14T11:23:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8005430 con 0x7f56f8072360 2023-10-14T11:23:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f80b4300 con 0x7f56f8072360 2023-10-14T11:23:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80038c0 con 0x7f56f8072360 2023-10-14T11:23:24.261 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.249+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f80b48c0 con 0x7f56f8072360 2023-10-14T11:23:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.250+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f806eab0 con 0x7f56f8072360 2023-10-14T11:23:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.251+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f56e8003a20 con 0x7f56f8072360 2023-10-14T11:23:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.251+0000 7f56effff700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.251+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56e8088b40 con 0x7f56f8072360 2023-10-14T11:23:24.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.251+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.252+0000 7f56f6ffd700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 0x7f56d806d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56f81f6b90 tx=0x7f56e0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.255+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56e8053bf0 con 0x7f56f8072360 2023-10-14T11:23:24.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.457+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56f804ebb0 con 0x7f56f8072360 2023-10-14T11:23:24.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.457+0000 7f56effff700 1 -- 172.21.15.67:0/3210615654 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56e8057210 con 0x7f56f8072360 2023-10-14T11:23:24.461 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 msgr2=0x7f56d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 0x7f56d806d3c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f56f81f6b90 tx=0x7f56e0008030 comp rx=0 tx=0).stop 2023-10-14T11:23:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 msgr2=0x7f56f80b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56e800c450 tx=0x7f56e800c810 comp rx=0 tx=0).stop 2023-10-14T11:23:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 shutdown_connections 2023-10-14T11:23:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f56f81f3310 0x7f56f81531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f56d806af00 0x7f56d806d3c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f56f8072360 0x7f56f80b2960 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 --2- 172.21.15.67:0/3210615654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56f815d920 0x7f56f81f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 >> 172.21.15.67:0/3210615654 conn(0x7f56f80b1760 msgr2=0x7f56f806dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 shutdown_connections 2023-10-14T11:23:24.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.460+0000 7f56fe105700 1 -- 172.21.15.67:0/3210615654 wait complete. 2023-10-14T11:23:24.475 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:24.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.601+0000 7f354ee78700 1 Processor -- start 2023-10-14T11:23:24.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.601+0000 7f354ee78700 1 -- start start 2023-10-14T11:23:24.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354ee78700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35480b0bb0 0x7f35480cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354ee78700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35480b0f90 con 0x7f35480b1250 2023-10-14T11:23:24.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354ee78700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35480cc820 con 0x7f354806b3b0 2023-10-14T11:23:24.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354ee78700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35480cde00 con 0x7f35480b0bb0 2023-10-14T11:23:24.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354cc14700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35480b0bb0 0x7f35480cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354d415700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f35480b1250 0x7f35480cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41390/0 (socket says 172.21.15.67:41390) 2023-10-14T11:23:24.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.602+0000 7f354d415700 1 -- 172.21.15.67:0/218388511 learned_addr learned my addr 172.21.15.67:0/218388511 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:24.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f354cc14700 1 -- 172.21.15.67:0/218388511 >> v1:172.21.15.72:6789/0 conn(0x7f354806b3b0 legacy=0x7f35480cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:24.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f354cc14700 1 -- 172.21.15.67:0/218388511 >> v1:172.21.15.67:6789/0 conn(0x7f35480b1250 legacy=0x7f35480cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f354cc14700 1 -- 172.21.15.67:0/218388511 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35480ccb00 con 0x7f35480b0bb0 2023-10-14T11:23:24.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f35477fe700 1 -- 172.21.15.67:0/218388511 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668913530 0 0) 0x7f35480b0f90 con 0x7f35480b1250 2023-10-14T11:23:24.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f354cc14700 1 --2- 172.21.15.67:0/218388511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b0bb0 0x7f35480cd8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3540009d90 tx=0x7f354000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12f87618a07d037 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f35477fe700 1 -- 172.21.15.67:0/218388511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000e070 con 0x7f35480b0bb0 2023-10-14T11:23:24.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f35477fe700 1 -- 172.21.15.67:0/218388511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000bb90 con 0x7f35480b0bb0 2023-10-14T11:23:24.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.603+0000 7f35477fe700 1 -- 172.21.15.67:0/218388511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540003a20 con 0x7f35480b0bb0 2023-10-14T11:23:24.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 -- 172.21.15.67:0/218388511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b0bb0 msgr2=0x7f35480cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 --2- 172.21.15.67:0/218388511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b0bb0 0x7f35480cd8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3540009d90 tx=0x7f354000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:24.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 -- 172.21.15.67:0/218388511 shutdown_connections 2023-10-14T11:23:24.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 --2- 172.21.15.67:0/218388511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b0bb0 0x7f35480cd8c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 -- 172.21.15.67:0/218388511 >> 172.21.15.67:0/218388511 conn(0x7f35480d04b0 msgr2=0x7f35480d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:24.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 -- 172.21.15.67:0/218388511 shutdown_connections 2023-10-14T11:23:24.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.604+0000 7f354ee78700 1 -- 172.21.15.67:0/218388511 wait complete. 2023-10-14T11:23:24.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.606+0000 7f354ee78700 1 Processor -- start 2023-10-14T11:23:24.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.606+0000 7f354ee78700 1 -- start start 2023-10-14T11:23:24.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f354806b3b0 0x7f354815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 0x7f354815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480ae340 con 0x7f35480b1250 2023-10-14T11:23:24.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480ad2a0 con 0x7f35480b0bb0 2023-10-14T11:23:24.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354ee78700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35480ad580 con 0x7f354806b3b0 2023-10-14T11:23:24.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42102/0 (socket says 172.21.15.67:42102) 2023-10-14T11:23:24.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 -- 172.21.15.67:0/3783980098 learned_addr learned my addr 172.21.15.67:0/3783980098 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:24.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354cc14700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f354806b3b0 0x7f354815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f3547fff700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 0x7f354815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 -- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f354806b3b0 msgr2=0x7f354815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.617 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f354806b3b0 0x7f354815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 -- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 msgr2=0x7f354815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 0x7f354815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 -- 172.21.15.67:0/3783980098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009a70 con 0x7f35480b1250 2023-10-14T11:23:24.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f3547fff700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 0x7f354815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:24.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f354d415700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f353800c410 tx=0x7f353800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.607+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538004c80 con 0x7f35480b1250 2023-10-14T11:23:24.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.608+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538004de0 con 0x7f35480b1250 2023-10-14T11:23:24.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.608+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35380072f0 con 0x7f35480b1250 2023-10-14T11:23:24.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.608+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35480ad860 con 0x7f35480b1250 2023-10-14T11:23:24.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.608+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35480ade20 con 0x7f35480b1250 2023-10-14T11:23:24.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.609+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35480ae040 con 0x7f35480b1250 2023-10-14T11:23:24.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.609+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3538007450 con 0x7f35480b1250 2023-10-14T11:23:24.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.609+0000 7f35457fa700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 0x7f352806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:24.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.609+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3538089190 con 0x7f35480b1250 2023-10-14T11:23:24.620 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.610+0000 7f354cc14700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 0x7f352806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:24.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.610+0000 7f354cc14700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 0x7f352806d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f80 tx=0x7f3540011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:24.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.614+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3538054230 con 0x7f35480b1250 2023-10-14T11:23:24.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.813+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f354804ebb0 con 0x7f35480b1250 2023-10-14T11:23:24.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.814+0000 7f35457fa700 1 -- 172.21.15.67:0/3783980098 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3538057850 con 0x7f35480b1250 2023-10-14T11:23:24.818 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:24.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 msgr2=0x7f352806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 0x7f352806d3f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f80 tx=0x7f3540011000 comp rx=0 tx=0).stop 2023-10-14T11:23:24.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 msgr2=0x7f3548160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:24.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f353800c410 tx=0x7f353800c720 comp rx=0 tx=0).stop 2023-10-14T11:23:24.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 shutdown_connections 2023-10-14T11:23:24.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f352806af30 0x7f352806d3f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35480b1250 0x7f3548160940 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f354806b3b0 0x7f354815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 --2- 172.21.15.67:0/3783980098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35480b0bb0 0x7f354815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:24.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 >> 172.21.15.67:0/3783980098 conn(0x7f35480d04b0 msgr2=0x7f35480d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:24.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 shutdown_connections 2023-10-14T11:23:24.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.816+0000 7f354ee78700 1 -- 172.21.15.67:0/3783980098 wait complete. 2023-10-14T11:23:24.832 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:24.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.957+0000 7f51f56a1700 1 Processor -- start 2023-10-14T11:23:25.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.957+0000 7f51f56a1700 1 -- start start 2023-10-14T11:23:25.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51f56a1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51f00cedf0 0x7f51f00cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51f56a1700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f00cf250 con 0x7f51f00cb4b0 2023-10-14T11:23:25.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51f56a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f015b440 con 0x7f51f00cd550 2023-10-14T11:23:25.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51f56a1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f015b720 con 0x7f51f00cedf0 2023-10-14T11:23:25.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51ee7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51f00cedf0 0x7f51f00cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51ee7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f51f00cedf0 0x7f51f00cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42108/0 (socket says 172.21.15.67:42108) 2023-10-14T11:23:25.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51ee7fc700 1 -- 172.21.15.67:0/199353635 learned_addr learned my addr 172.21.15.67:0/199353635 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:25.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.958+0000 7f51eeffd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f51f00cb4b0 0x7f51f015ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41400/0 (socket says 172.21.15.67:41400) 2023-10-14T11:23:25.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51ee7fc700 1 -- 172.21.15.67:0/199353635 >> v1:172.21.15.72:6789/0 conn(0x7f51f00cd550 legacy=0x7f51f015e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:25.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51ee7fc700 1 -- 172.21.15.67:0/199353635 >> v1:172.21.15.67:6789/0 conn(0x7f51f00cb4b0 legacy=0x7f51f015ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51ee7fc700 1 -- 172.21.15.67:0/199353635 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f015ba00 con 0x7f51f00cedf0 2023-10-14T11:23:25.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51edffb700 1 -- 172.21.15.67:0/199353635 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844584777 0 0) 0x7f51f00cf250 con 0x7f51f00cb4b0 2023-10-14T11:23:25.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51ee7fc700 1 --2- 172.21.15.67:0/199353635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cedf0 0x7f51f00cd010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51e000bb90 tx=0x7f51e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1588c638b6f8cf38 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51edffb700 1 -- 172.21.15.67:0/199353635 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e000dd10 con 0x7f51f00cedf0 2023-10-14T11:23:25.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51edffb700 1 -- 172.21.15.67:0/199353635 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e000de70 con 0x7f51f00cedf0 2023-10-14T11:23:25.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.959+0000 7f51edffb700 1 -- 172.21.15.67:0/199353635 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004230 con 0x7f51f00cedf0 2023-10-14T11:23:25.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 -- 172.21.15.67:0/199353635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cedf0 msgr2=0x7f51f00cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 --2- 172.21.15.67:0/199353635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cedf0 0x7f51f00cd010 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f51e000bb90 tx=0x7f51e000bea0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 -- 172.21.15.67:0/199353635 shutdown_connections 2023-10-14T11:23:25.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 --2- 172.21.15.67:0/199353635 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cedf0 0x7f51f00cd010 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 -- 172.21.15.67:0/199353635 >> 172.21.15.67:0/199353635 conn(0x7f51f006d180 msgr2=0x7f51f006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 -- 172.21.15.67:0/199353635 shutdown_connections 2023-10-14T11:23:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.960+0000 7f51f56a1700 1 -- 172.21.15.67:0/199353635 wait complete. 2023-10-14T11:23:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.961+0000 7f51f56a1700 1 Processor -- start 2023-10-14T11:23:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 -- start start 2023-10-14T11:23:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51f00cd550 0x7f51f0151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51f00cedf0 0x7f51f00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0153340 con 0x7f51f00cb4b0 2023-10-14T11:23:25.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c6030 con 0x7f51f00cedf0 2023-10-14T11:23:25.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.962+0000 7f51f56a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0153760 con 0x7f51f00cd550 2023-10-14T11:23:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42112/0 (socket says 172.21.15.67:42112) 2023-10-14T11:23:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 -- 172.21.15.67:0/2300586605 learned_addr learned my addr 172.21.15.67:0/2300586605 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51ef7fe700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51f00cedf0 0x7f51f00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51ee7fc700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51f00cd550 0x7f51f0151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 -- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51f00cd550 msgr2=0x7f51f0151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51f00cd550 0x7f51f0151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 -- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51f00cedf0 msgr2=0x7f51f00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51f00cedf0 0x7f51f00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 -- 172.21.15.67:0/2300586605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e000b7f0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51eeffd700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c550 tx=0x7f51e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400cea0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e4004ca0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00c7f20 con 0x7f51f00cb4b0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e4007310 con 0x7f51f00cb4b0 2023-10-14T11:23:25.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.963+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f01526c0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.964+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f01535b0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.965+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51e4007470 con 0x7f51f00cb4b0 2023-10-14T11:23:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.965+0000 7f51d77fe700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 0x7f51dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.965+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51e4089190 con 0x7f51f00cb4b0 2023-10-14T11:23:25.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.965+0000 7f51ee7fc700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 0x7f51dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.966+0000 7f51ee7fc700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 0x7f51dc06d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51e000b340 tx=0x7f51e001d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:24.970+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51e4054240 con 0x7f51f00cb4b0 2023-10-14T11:23:25.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.172+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51f004ebb0 con 0x7f51f00cb4b0 2023-10-14T11:23:25.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.173+0000 7f51d77fe700 1 -- 172.21.15.67:0/2300586605 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51e4057860 con 0x7f51f00cb4b0 2023-10-14T11:23:25.176 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:25.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 msgr2=0x7f51dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 0x7f51dc06d3c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f51e000b340 tx=0x7f51e001d040 comp rx=0 tx=0).stop 2023-10-14T11:23:25.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 msgr2=0x7f51f00c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c550 tx=0x7f51e400c860 comp rx=0 tx=0).stop 2023-10-14T11:23:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 shutdown_connections 2023-10-14T11:23:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51f00cedf0 0x7f51f00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f51dc06af00 0x7f51dc06d3c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f51f00cb4b0 0x7f51f00c5af0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 --2- 172.21.15.67:0/2300586605 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f51f00cd550 0x7f51f0151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 >> 172.21.15.67:0/2300586605 conn(0x7f51f006d180 msgr2=0x7f51f00cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 shutdown_connections 2023-10-14T11:23:25.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.175+0000 7f51f56a1700 1 -- 172.21.15.67:0/2300586605 wait complete. 2023-10-14T11:23:25.190 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:25.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 Processor -- start 2023-10-14T11:23:25.316 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 -- start start 2023-10-14T11:23:25.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 0x7f6e0c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0cef10 con 0x7f6e0c0ceb30 2023-10-14T11:23:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c0d2090 con 0x7f6e0c0cffe0 2023-10-14T11:23:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.313+0000 7f6e10f5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b0920 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0a59c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6e0c0ceb30 0x7f6e0c0cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41414/0 (socket says 172.21.15.67:41414) 2023-10-14T11:23:25.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0a59c700 1 -- 172.21.15.67:0/1616148326 learned_addr learned my addr 172.21.15.67:0/1616148326 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/1616148326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 0x7f6e0c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126100859 0 0) 0x7f6e0c0cef10 con 0x7f6e0c0ceb30 2023-10-14T11:23:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6df40035b0 con 0x7f6e0c0ceb30 2023-10-14T11:23:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235496178 0 0) 0x7f6e0c0d2090 con 0x7f6e0c0cffe0 2023-10-14T11:23:25.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e0c0cef10 con 0x7f6e0c0cffe0 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e09d9b700 1 -- 172.21.15.67:0/1616148326 >> v1:172.21.15.72:6789/0 conn(0x7f6e0c0cffe0 legacy=0x7f6e0c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e09d9b700 1 -- 172.21.15.67:0/1616148326 >> v1:172.21.15.67:6789/0 conn(0x7f6e0c0ceb30 legacy=0x7f6e0c0cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 805046067 0 0) 0x7f6df40035b0 con 0x7f6e0c0ceb30 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e09d9b700 1 -- 172.21.15.67:0/1616148326 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c15deb0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/1616148326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 0x7f6e0c0cfaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009870 tx=0x7f6dfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3fec87a48401d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.314+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00001670 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dfc004030 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e0959a700 1 -- 172.21.15.67:0/1616148326 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc0043c0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 -- 172.21.15.67:0/1616148326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 msgr2=0x7f6e0c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/1616148326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 0x7f6e0c0cfaa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009870 tx=0x7f6dfc009b80 comp rx=0 tx=0).stop 2023-10-14T11:23:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 -- 172.21.15.67:0/1616148326 shutdown_connections 2023-10-14T11:23:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/1616148326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0b04c0 0x7f6e0c0cfaa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 -- 172.21.15.67:0/1616148326 >> 172.21.15.67:0/1616148326 conn(0x7f6e0c0d1570 msgr2=0x7f6e0c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 -- 172.21.15.67:0/1616148326 shutdown_connections 2023-10-14T11:23:25.323 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.315+0000 7f6e10f5e700 1 -- 172.21.15.67:0/1616148326 wait complete. 2023-10-14T11:23:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 Processor -- start 2023-10-14T11:23:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 -- start start 2023-10-14T11:23:25.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 0x7f6e0c0cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 0x7f6e0c1f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b6720 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b5aa0 con 0x7f6e0c0cffe0 2023-10-14T11:23:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e10f5e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0b5d80 con 0x7f6e0c0ceb30 2023-10-14T11:23:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e0a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e0a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42126/0 (socket says 172.21.15.67:42126) 2023-10-14T11:23:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.317+0000 7f6e0a59c700 1 -- 172.21.15.67:0/2299918376 learned_addr learned my addr 172.21.15.67:0/2299918376 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:25.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0ad9d700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 0x7f6e0c1f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 0x7f6e0c0cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 -- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 msgr2=0x7f6e0c0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 0x7f6e0c0cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 -- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 msgr2=0x7f6e0c1f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 0x7f6e0c1f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 -- 172.21.15.67:0/2299918376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0094a0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0ad9d700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 0x7f6e0c1f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:25.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 0x7f6e0c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:25.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e0a59c700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000c750 tx=0x7f6e0000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00007560 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000076c0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c0b6060 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00004ab0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.318+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0b5730 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.319+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c04ebb0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.320+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e00004c10 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.320+0000 7f6dfaffd700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.320+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e00088960 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.320+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.321+0000 7f6e09d9b700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0097c0 tx=0x7f6dfc013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.325+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e00053aa0 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.528+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0c067320 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.529+0000 7f6dfaffd700 1 -- 172.21.15.67:0/2299918376 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f6e00018020 con 0x7f6e0c0b04c0 2023-10-14T11:23:25.533 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:25.533 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:25.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 msgr2=0x7f6dec06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0097c0 tx=0x7f6dfc013040 comp rx=0 tx=0).stop 2023-10-14T11:23:25.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 msgr2=0x7f6e0c1529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000c750 tx=0x7f6e0000cb10 comp rx=0 tx=0).stop 2023-10-14T11:23:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 shutdown_connections 2023-10-14T11:23:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e0c0cffe0 0x7f6e0c1f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6dec06af30 0x7f6dec06d3f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e0c0b04c0 0x7f6e0c1529b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 --2- 172.21.15.67:0/2299918376 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e0c0ceb30 0x7f6e0c0cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 >> 172.21.15.67:0/2299918376 conn(0x7f6e0c0d1570 msgr2=0x7f6e0c0cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 shutdown_connections 2023-10-14T11:23:25.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.532+0000 7f6e10f5e700 1 -- 172.21.15.67:0/2299918376 wait complete. 2023-10-14T11:23:25.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:25.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:25.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 Processor -- start 2023-10-14T11:23:25.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 -- start start 2023-10-14T11:23:25.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f041c166290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c15bbb0 con 0x7f041c0b6f70 2023-10-14T11:23:25.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0cf6a0 con 0x7f041c15b7d0 2023-10-14T11:23:25.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f0422073700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0d0460 con 0x7f041c0cc2b0 2023-10-14T11:23:25.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041affd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f041c0b6f70 0x7f041c0cbba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41430/0 (socket says 172.21.15.67:41430) 2023-10-14T11:23:25.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041affd700 1 -- 172.21.15.67:0/1351280145 learned_addr learned my addr 172.21.15.67:0/1351280145 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:25.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041bfff700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f041c166290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792508705 0 0) 0x7f0404001110 con 0x7f041c0b6f70 2023-10-14T11:23:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04080035b0 con 0x7f041c0b6f70 2023-10-14T11:23:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019737254 0 0) 0x7f041c0cf6a0 con 0x7f041c15b7d0 2023-10-14T11:23:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0404001110 con 0x7f041c15b7d0 2023-10-14T11:23:25.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227652994 0 0) 0x7f04080035b0 con 0x7f041c0b6f70 2023-10-14T11:23:25.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 msgr2=0x7f041c166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:25.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f041c166290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 >> v1:172.21.15.72:6789/0 conn(0x7f041c15b7d0 legacy=0x7f041c0d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0cf980 con 0x7f041c0b6f70 2023-10-14T11:23:25.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.674+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f0404001800 con 0x7f041c0b6f70 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 >> v1:172.21.15.67:6789/0 conn(0x7f041c0b6f70 legacy=0x7f041c0cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0408003bc0 0x7f0408003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408004850 0x7f0408004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f0408005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0d0460 con 0x7f0408003bc0 2023-10-14T11:23:25.684 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040800bac0 con 0x7f0408004850 2023-10-14T11:23:25.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040800bc80 con 0x7f041c0cc2b0 2023-10-14T11:23:25.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0408003bc0 0x7f0408003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041affd700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408004850 0x7f0408004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041bfff700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f0408005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 -- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 msgr2=0x7f0408005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:25.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0cc2b0 0x7f0408005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 -- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408004850 msgr2=0x7f0408004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:25.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408004850 0x7f0408004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 -- 172.21.15.67:0/1351280145 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080035b0 con 0x7f0408003bc0 2023-10-14T11:23:25.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041b7fe700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0408003bc0 0x7f0408003fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f040c007fd0 tx=0x7f0408005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcfdaa60ef8c9ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c001430 con 0x7f0408003bc0 2023-10-14T11:23:25.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0052d0 con 0x7f0408003bc0 2023-10-14T11:23:25.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.675+0000 7f041a7fc700 1 -- 172.21.15.67:0/1351280145 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c001d40 con 0x7f0408003bc0 2023-10-14T11:23:25.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 -- 172.21.15.67:0/1351280145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0408003bc0 msgr2=0x7f0408003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 --2- 172.21.15.67:0/1351280145 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0408003bc0 0x7f0408003fc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f040c007fd0 tx=0x7f0408005880 comp rx=0 tx=0).stop 2023-10-14T11:23:25.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f041bfff700 1 -- 172.21.15.67:0/1351280145 reap_dead start 2023-10-14T11:23:25.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 -- 172.21.15.67:0/1351280145 shutdown_connections 2023-10-14T11:23:25.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 -- 172.21.15.67:0/1351280145 >> 172.21.15.67:0/1351280145 conn(0x7f041c0665a0 msgr2=0x7f041c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 -- 172.21.15.67:0/1351280145 shutdown_connections 2023-10-14T11:23:25.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.676+0000 7f0422073700 1 -- 172.21.15.67:0/1351280145 wait complete. 2023-10-14T11:23:25.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.677+0000 7f0422073700 1 Processor -- start 2023-10-14T11:23:25.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.677+0000 7f0422073700 1 -- start start 2023-10-14T11:23:25.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 0x7f041c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0d0ae0 0x7f041c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0d0f60 con 0x7f041c15e730 2023-10-14T11:23:25.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15ebb0 con 0x7f0408003bc0 2023-10-14T11:23:25.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f0422073700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c147c80 con 0x7f041c0d0ae0 2023-10-14T11:23:25.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42150/0 (socket says 172.21.15.67:42150) 2023-10-14T11:23:25.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 -- 172.21.15.67:0/153889231 learned_addr learned my addr 172.21.15.67:0/153889231 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:25.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041b7fe700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 0x7f041c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041affd700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0d0ae0 0x7f041c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 -- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0d0ae0 msgr2=0x7f041c15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0d0ae0 0x7f041c15e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 -- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 msgr2=0x7f041c0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 0x7f041c0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.678+0000 7f041bfff700 1 -- 172.21.15.67:0/153889231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c143e00 con 0x7f041c15e730 2023-10-14T11:23:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f041b7fe700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 0x7f041c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:25.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f041bfff700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f041c0b76c0 tx=0x7f041400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400e040 con 0x7f041c15e730 2023-10-14T11:23:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041400f040 con 0x7f041c15e730 2023-10-14T11:23:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c1440d0 con 0x7f041c15e730 2023-10-14T11:23:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414015430 con 0x7f041c15e730 2023-10-14T11:23:25.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.679+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c144690 con 0x7f041c15e730 2023-10-14T11:23:25.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.680+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c04ebb0 con 0x7f041c15e730 2023-10-14T11:23:25.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.680+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0414015590 con 0x7f041c15e730 2023-10-14T11:23:25.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.681+0000 7f0413fff700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 0x7f03fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:25.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.681+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0414089c10 con 0x7f041c15e730 2023-10-14T11:23:25.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.681+0000 7f041b7fe700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 0x7f03fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:25.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.681+0000 7f041b7fe700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 0x7f03fc06d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f040c005040 tx=0x7f040c00a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:25.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.686+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0414054cc0 con 0x7f041c15e730 2023-10-14T11:23:25.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.887+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f041c0b15b0 con 0x7f041c15e730 2023-10-14T11:23:25.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.887+0000 7f0413fff700 1 -- 172.21.15.67:0/153889231 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04140582e0 con 0x7f041c15e730 2023-10-14T11:23:25.890 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:25.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 msgr2=0x7f03fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 0x7f03fc06d3c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f040c005040 tx=0x7f040c00a000 comp rx=0 tx=0).stop 2023-10-14T11:23:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 msgr2=0x7f041c141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f041c0b76c0 tx=0x7f041400f490 comp rx=0 tx=0).stop 2023-10-14T11:23:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 shutdown_connections 2023-10-14T11:23:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f03fc06af00 0x7f03fc06d3c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f041c15e730 0x7f041c141000 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0408003bc0 0x7f041c0d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 --2- 172.21.15.67:0/153889231 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f041c0d0ae0 0x7f041c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 >> 172.21.15.67:0/153889231 conn(0x7f041c0665a0 msgr2=0x7f041c0c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 shutdown_connections 2023-10-14T11:23:25.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:25.889+0000 7f0422073700 1 -- 172.21.15.67:0/153889231 wait complete. 2023-10-14T11:23:25.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:26.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.029+0000 7ff5ecc4d700 1 Processor -- start 2023-10-14T11:23:26.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.029+0000 7ff5ecc4d700 1 -- start start 2023-10-14T11:23:26.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5ecc4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5ecc4d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 0x7ff5e80cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5ecc4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e80b0f90 con 0x7ff5e80cfeb0 2023-10-14T11:23:26.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5ecc4d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80cde00 con 0x7ff5e806b3b0 2023-10-14T11:23:26.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5ecc4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80cc820 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5e5d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 0x7ff5e80cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5e6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff5e80cfeb0 0x7ff5e80b1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48274/0 (socket says 172.21.15.67:48274) 2023-10-14T11:23:26.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.030+0000 7ff5e6d9d700 1 -- 172.21.15.67:0/139126622 learned_addr learned my addr 172.21.15.67:0/139126622 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:26.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e659c700 1 -- 172.21.15.67:0/139126622 >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 msgr2=0x7ff5e80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:26.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e659c700 1 --2- 172.21.15.67:0/139126622 >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 0x7ff5e80cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e659c700 1 -- 172.21.15.67:0/139126622 >> v1:172.21.15.72:6789/0 conn(0x7ff5e80cfeb0 legacy=0x7ff5e80b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e659c700 1 -- 172.21.15.67:0/139126622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80ccb00 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e5d9b700 1 --2- 172.21.15.67:0/139126622 >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 0x7ff5e80cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:26.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e659c700 1 --2- 172.21.15.67:0/139126622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e80cd8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009840 tx=0x7ff5d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611ae664d5adb266 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e559a700 1 -- 172.21.15.67:0/139126622 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8011830 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e559a700 1 -- 172.21.15.67:0/139126622 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8011990 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5e559a700 1 -- 172.21.15.67:0/139126622 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8011d20 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/139126622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 msgr2=0x7ff5e80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.031+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/139126622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e80cd8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009840 tx=0x7ff5d8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:26.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/139126622 shutdown_connections 2023-10-14T11:23:26.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/139126622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e80cd8c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/139126622 >> v2:172.21.15.72:3300/0 conn(0x7ff5e806b3b0 0x7ff5e80cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/139126622 >> 172.21.15.67:0/139126622 conn(0x7ff5e80d04b0 msgr2=0x7ff5e80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/139126622 shutdown_connections 2023-10-14T11:23:26.039 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.032+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/139126622 wait complete. 2023-10-14T11:23:26.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.033+0000 7ff5ecc4d700 1 Processor -- start 2023-10-14T11:23:26.041 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.033+0000 7ff5ecc4d700 1 -- start start 2023-10-14T11:23:26.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e81f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e80cfeb0 0x7ff5e81f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e815f600 con 0x7ff5e806b3b0 2023-10-14T11:23:26.042 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e815f2d0 con 0x7ff5e80cfeb0 2023-10-14T11:23:26.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5ecc4d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8144360 con 0x7ff5e80b0bb0 2023-10-14T11:23:26.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42160/0 (socket says 172.21.15.67:42160) 2023-10-14T11:23:26.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 -- 172.21.15.67:0/2714827339 learned_addr learned my addr 172.21.15.67:0/2714827339 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:26.043 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e5d9b700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e81f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e6d9d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e80cfeb0 0x7ff5e81f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 -- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 msgr2=0x7ff5e81f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e81f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.044 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 -- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e80cfeb0 msgr2=0x7ff5e81f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e80cfeb0 0x7ff5e81f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 -- 172.21.15.67:0/2714827339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0094a0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.034+0000 7ff5e659c700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009fd0 tx=0x7ff5d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.035+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80036a0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.045 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.035+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d801f070 con 0x7ff5e806b3b0 2023-10-14T11:23:26.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.035+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d80094a0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.035+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8003a60 con 0x7ff5e806b3b0 2023-10-14T11:23:26.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.035+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e80b01b0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.036+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e804ebb0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.046 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.036+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5d8003bc0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.036+0000 7ff5d6ffd700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 0x7ff5c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.036+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d8021070 con 0x7ff5e806b3b0 2023-10-14T11:23:26.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.037+0000 7ff5e5d9b700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 0x7ff5c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.047 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.037+0000 7ff5e5d9b700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 0x7ff5c806d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80c4250 tx=0x7ff5dc009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.048 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.041+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5d8055e90 con 0x7ff5e806b3b0 2023-10-14T11:23:26.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.242+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5e8071ea0 con 0x7ff5e806b3b0 2023-10-14T11:23:26.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.243+0000 7ff5d6ffd700 1 -- 172.21.15.67:0/2714827339 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5d802b020 con 0x7ff5e806b3b0 2023-10-14T11:23:26.245 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 msgr2=0x7ff5c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 0x7ff5c806d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80c4250 tx=0x7ff5dc009210 comp rx=0 tx=0).stop 2023-10-14T11:23:26.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 msgr2=0x7ff5e80ad2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009fd0 tx=0x7ff5d8004750 comp rx=0 tx=0).stop 2023-10-14T11:23:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 shutdown_connections 2023-10-14T11:23:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e80cfeb0 0x7ff5e81f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c806af00 0x7ff5c806d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e806b3b0 0x7ff5e80ad2e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 --2- 172.21.15.67:0/2714827339 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e80b0bb0 0x7ff5e81f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 >> 172.21.15.67:0/2714827339 conn(0x7ff5e80d04b0 msgr2=0x7ff5e806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 shutdown_connections 2023-10-14T11:23:26.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.245+0000 7ff5ecc4d700 1 -- 172.21.15.67:0/2714827339 wait complete. 2023-10-14T11:23:26.259 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.385+0000 7fb54476a700 1 Processor -- start 2023-10-14T11:23:26.387 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.385+0000 7fb54476a700 1 -- start start 2023-10-14T11:23:26.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb54476a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb53c0b25a0 0x7fb53c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb54476a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0b2cc0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb54476a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c161520 con 0x7fb53c0d0090 2023-10-14T11:23:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb54476a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0d2860 con 0x7fb53c0b25a0 2023-10-14T11:23:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541d05700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb53c0b25a0 0x7fb53c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb542d07700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb53c0b3fb0 0x7fb53c0d0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41466/0 (socket says 172.21.15.67:41466) 2023-10-14T11:23:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb542d07700 1 -- 172.21.15.67:0/337166528 learned_addr learned my addr 172.21.15.67:0/337166528 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541d05700 1 -- 172.21.15.67:0/337166528 >> v1:172.21.15.72:6789/0 conn(0x7fb53c0d0090 legacy=0x7fb53c0d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541d05700 1 -- 172.21.15.67:0/337166528 >> v1:172.21.15.67:6789/0 conn(0x7fb53c0b3fb0 legacy=0x7fb53c0d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541d05700 1 -- 172.21.15.67:0/337166528 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0cfad0 con 0x7fb53c0b25a0 2023-10-14T11:23:26.391 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541504700 1 -- 172.21.15.67:0/337166528 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015482030 0 0) 0x7fb53c0b2cc0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.386+0000 7fb541d05700 1 --2- 172.21.15.67:0/337166528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b25a0 0x7fb53c0b3a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb538009840 tx=0x7fb538009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debda2cb6d22a64a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb541504700 1 -- 172.21.15.67:0/337166528 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538011830 con 0x7fb53c0b25a0 2023-10-14T11:23:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb541504700 1 -- 172.21.15.67:0/337166528 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb538011990 con 0x7fb53c0b25a0 2023-10-14T11:23:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb541504700 1 -- 172.21.15.67:0/337166528 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538011d20 con 0x7fb53c0b25a0 2023-10-14T11:23:26.392 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 -- 172.21.15.67:0/337166528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b25a0 msgr2=0x7fb53c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 --2- 172.21.15.67:0/337166528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b25a0 0x7fb53c0b3a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb538009840 tx=0x7fb538009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 -- 172.21.15.67:0/337166528 shutdown_connections 2023-10-14T11:23:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 --2- 172.21.15.67:0/337166528 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b25a0 0x7fb53c0b3a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 -- 172.21.15.67:0/337166528 >> 172.21.15.67:0/337166528 conn(0x7fb53c09cb00 msgr2=0x7fb53c0d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.393 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 -- 172.21.15.67:0/337166528 shutdown_connections 2023-10-14T11:23:26.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.387+0000 7fb54476a700 1 -- 172.21.15.67:0/337166528 wait complete. 2023-10-14T11:23:26.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.388+0000 7fb54476a700 1 Processor -- start 2023-10-14T11:23:26.396 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 -- start start 2023-10-14T11:23:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb53c0b25a0 0x7fb53c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 0x7fb53c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cbe00 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cb1f0 con 0x7fb53c0d0090 2023-10-14T11:23:26.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb54476a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cb4d0 con 0x7fb53c0b25a0 2023-10-14T11:23:26.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb541d05700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb541d05700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42176/0 (socket says 172.21.15.67:42176) 2023-10-14T11:23:26.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb541d05700 1 -- 172.21.15.67:0/1298966317 learned_addr learned my addr 172.21.15.67:0/1298966317 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:26.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb542506700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb53c0b25a0 0x7fb53c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.389+0000 7fb542d07700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 0x7fb53c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 -- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb53c0b25a0 msgr2=0x7fb53c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb53c0b25a0 0x7fb53c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 -- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 msgr2=0x7fb53c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 0x7fb53c15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 -- 172.21.15.67:0/1298966317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380094a0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb542d07700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 0x7fb53c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb541d05700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb538014040 tx=0x7fb538004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801a850 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53801a9b0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53801ad20 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c0cb7b0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.390+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c15b440 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.391+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c15b5d0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.391+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb538022070 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.392+0000 7fb532ffd700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 0x7fb52006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.392+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb53808a360 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.392+0000 7fb542506700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 0x7fb52006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.392+0000 7fb542506700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 0x7fb52006d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000f60 tx=0x7fb52c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.396+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb538055550 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.597+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb53c04ebb0 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.597+0000 7fb532ffd700 1 -- 172.21.15.67:0/1298966317 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb538058b70 con 0x7fb53c0b3fb0 2023-10-14T11:23:26.600 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:26.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 msgr2=0x7fb52006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 0x7fb52006d3c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000f60 tx=0x7fb52c009040 comp rx=0 tx=0).stop 2023-10-14T11:23:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 msgr2=0x7fb53c0ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb538014040 tx=0x7fb538004750 comp rx=0 tx=0).stop 2023-10-14T11:23:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 shutdown_connections 2023-10-14T11:23:26.602 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb53c0d0090 0x7fb53c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb53c0b25a0 0x7fb53c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb52006af00 0x7fb52006d3c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 --2- 172.21.15.67:0/1298966317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb53c0b3fb0 0x7fb53c0ca810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 >> 172.21.15.67:0/1298966317 conn(0x7fb53c09cb00 msgr2=0x7fb53c15fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.603 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 shutdown_connections 2023-10-14T11:23:26.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.599+0000 7fb54476a700 1 -- 172.21.15.67:0/1298966317 wait complete. 2023-10-14T11:23:26.614 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:26.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.736+0000 7f8d895cd700 1 Processor -- start 2023-10-14T11:23:26.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.736+0000 7f8d895cd700 1 -- start start 2023-10-14T11:23:26.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.737+0000 7f8d895cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d84072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.737+0000 7f8d895cd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8406a810 0x7f8d8406acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.737+0000 7f8d895cd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d84072b70 con 0x7f8d840cc260 2023-10-14T11:23:26.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.737+0000 7f8d895cd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8415bd60 con 0x7f8d8406a810 2023-10-14T11:23:26.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.737+0000 7f8d895cd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84071be0 con 0x7f8d8415b980 2023-10-14T11:23:26.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8406a810 0x7f8d8406acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d84072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d837fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8d840cc260 0x7f8d840caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48302/0 (socket says 172.21.15.67:48302) 2023-10-14T11:23:26.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d8406a810 0x7f8d8406acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42592/0 (socket says 172.21.15.67:42592) 2023-10-14T11:23:26.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d84072630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44454/0 (socket says 172.21.15.67:44454) 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d837fe700 1 -- 172.21.15.67:0/2735839923 learned_addr learned my addr 172.21.15.67:0/2735839923 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 -- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 msgr2=0x7f8d84072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 --2- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d84072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 -- 172.21.15.67:0/2735839923 >> v1:172.21.15.72:6789/0 conn(0x7f8d840cc260 legacy=0x7f8d840caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 -- 172.21.15.67:0/2735839923 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8406b2d0 con 0x7f8d8406a810 2023-10-14T11:23:26.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.738+0000 7f8d827fc700 1 --2- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8406a810 0x7f8d8406acc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3a1ce2b19593b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d81ffb700 1 -- 172.21.15.67:0/2735839923 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c011830 con 0x7f8d8406a810 2023-10-14T11:23:26.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d81ffb700 1 -- 172.21.15.67:0/2735839923 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c011990 con 0x7f8d8406a810 2023-10-14T11:23:26.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d81ffb700 1 -- 172.21.15.67:0/2735839923 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c011d20 con 0x7f8d8406a810 2023-10-14T11:23:26.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 -- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8406a810 msgr2=0x7f8d8406acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 --2- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8406a810 0x7f8d8406acc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:26.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 -- 172.21.15.67:0/2735839923 shutdown_connections 2023-10-14T11:23:26.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 --2- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d84072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 --2- 172.21.15.67:0/2735839923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d8406a810 0x7f8d8406acc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 -- 172.21.15.67:0/2735839923 >> 172.21.15.67:0/2735839923 conn(0x7f8d840d0440 msgr2=0x7f8d840d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 -- 172.21.15.67:0/2735839923 shutdown_connections 2023-10-14T11:23:26.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.739+0000 7f8d895cd700 1 -- 172.21.15.67:0/2735839923 wait complete. 2023-10-14T11:23:26.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 Processor -- start 2023-10-14T11:23:26.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 -- start start 2023-10-14T11:23:26.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d840cc260 0x7f8d840b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d8415a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414e860 con 0x7f8d8406a810 2023-10-14T11:23:26.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d841f1b40 con 0x7f8d840cc260 2023-10-14T11:23:26.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d895cd700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d841f1e20 con 0x7f8d8415b980 2023-10-14T11:23:26.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42188/0 (socket says 172.21.15.67:42188) 2023-10-14T11:23:26.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.741+0000 7f8d82ffd700 1 -- 172.21.15.67:0/1531364772 learned_addr learned my addr 172.21.15.67:0/1531364772 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:26.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d837fe700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d8415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d827fc700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d840cc260 0x7f8d840b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 -- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 msgr2=0x7f8d8415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d8415a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 -- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d840cc260 msgr2=0x7f8d840b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d840cc260 0x7f8d840b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 -- 172.21.15.67:0/1531364772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0094a0 con 0x7f8d8406a810 2023-10-14T11:23:26.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d82ffd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400e870 tx=0x7f8d7400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74009590 con 0x7f8d8406a810 2023-10-14T11:23:26.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400ee70 con 0x7f8d8406a810 2023-10-14T11:23:26.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d840b4e00 con 0x7f8d8406a810 2023-10-14T11:23:26.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400ca50 con 0x7f8d8406a810 2023-10-14T11:23:26.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.742+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d840b53c0 con 0x7f8d8406a810 2023-10-14T11:23:26.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.743+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840b5730 con 0x7f8d8406a810 2023-10-14T11:23:26.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.743+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d7400cbb0 con 0x7f8d8406a810 2023-10-14T11:23:26.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.744+0000 7f8d7b7fe700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:26.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.744+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d74089560 con 0x7f8d8406a810 2023-10-14T11:23:26.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.744+0000 7f8d827fc700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:26.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.745+0000 7f8d827fc700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 0x7f8d6406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:26.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.748+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d74054610 con 0x7f8d8406a810 2023-10-14T11:23:26.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.949+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d8404ebb0 con 0x7f8d8406a810 2023-10-14T11:23:26.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.951+0000 7f8d7b7fe700 1 -- 172.21.15.67:0/1531364772 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8d7400ce60 con 0x7f8d8406a810 2023-10-14T11:23:26.953 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:26.953 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.952+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 msgr2=0x7f8d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.952+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 0x7f8d6406d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009840 tx=0x7f8d6c008030 comp rx=0 tx=0).stop 2023-10-14T11:23:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.952+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 msgr2=0x7f8d841f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:26.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.952+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400e870 tx=0x7f8d7400ec30 comp rx=0 tx=0).stop 2023-10-14T11:23:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 shutdown_connections 2023-10-14T11:23:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8d8415b980 0x7f8d8415a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8d6406af00 0x7f8d6406d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8d8406a810 0x7f8d841f4f00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 --2- 172.21.15.67:0/1531364772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d840cc260 0x7f8d840b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 >> 172.21.15.67:0/1531364772 conn(0x7f8d840d0440 msgr2=0x7f8d84157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 shutdown_connections 2023-10-14T11:23:26.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:26.953+0000 7f8d895cd700 1 -- 172.21.15.67:0/1531364772 wait complete. 2023-10-14T11:23:26.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:26.968 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:27.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.094+0000 7fbac53a7700 1 Processor -- start 2023-10-14T11:23:27.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.094+0000 7fbac53a7700 1 -- start start 2023-10-14T11:23:27.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbac53a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 0x7fbac015e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbac53a7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbac00d06b0 0x7fbac00d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbac53a7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac015ddc0 con 0x7fbac00d4410 2023-10-14T11:23:27.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbac53a7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac015eea0 con 0x7fbac00d06b0 2023-10-14T11:23:27.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbac53a7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac00ce610 con 0x7fbac015d9e0 2023-10-14T11:23:27.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbac00d06b0 0x7fbac00d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbac00d06b0 0x7fbac00d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42198/0 (socket says 172.21.15.67:42198) 2023-10-14T11:23:27.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 -- 172.21.15.67:0/2835088946 learned_addr learned my addr 172.21.15.67:0/2835088946 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:27.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabeffd700 1 --2- 172.21.15.67:0/2835088946 >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 0x7fbac015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 -- 172.21.15.67:0/2835088946 >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 msgr2=0x7fbac015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:27.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 --2- 172.21.15.67:0/2835088946 >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 0x7fbac015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.095+0000 7fbabf7fe700 1 -- 172.21.15.67:0/2835088946 >> v1:172.21.15.72:6789/0 conn(0x7fbac00d4410 legacy=0x7fbac00cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabf7fe700 1 -- 172.21.15.67:0/2835088946 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac00cf6b0 con 0x7fbac00d06b0 2023-10-14T11:23:27.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabeffd700 1 --2- 172.21.15.67:0/2835088946 >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 0x7fbac015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:27.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabf7fe700 1 --2- 172.21.15.67:0/2835088946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d06b0 0x7fbac00d1330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbac008cf10 tx=0x7fbab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a52f7dc710b38c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabdffb700 1 -- 172.21.15.67:0/2835088946 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800e070 con 0x7fbac00d06b0 2023-10-14T11:23:27.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabdffb700 1 -- 172.21.15.67:0/2835088946 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab800b9c0 con 0x7fbac00d06b0 2023-10-14T11:23:27.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbabdffb700 1 -- 172.21.15.67:0/2835088946 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab800bd70 con 0x7fbac00d06b0 2023-10-14T11:23:27.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 -- 172.21.15.67:0/2835088946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d06b0 msgr2=0x7fbac00d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 --2- 172.21.15.67:0/2835088946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d06b0 0x7fbac00d1330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbac008cf10 tx=0x7fbab800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:27.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 -- 172.21.15.67:0/2835088946 shutdown_connections 2023-10-14T11:23:27.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 --2- 172.21.15.67:0/2835088946 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d06b0 0x7fbac00d1330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 --2- 172.21.15.67:0/2835088946 >> v2:172.21.15.72:3300/0 conn(0x7fbac015d9e0 0x7fbac015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 -- 172.21.15.67:0/2835088946 >> 172.21.15.67:0/2835088946 conn(0x7fbac008af10 msgr2=0x7fbac00d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:27.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 -- 172.21.15.67:0/2835088946 shutdown_connections 2023-10-14T11:23:27.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.096+0000 7fbac53a7700 1 -- 172.21.15.67:0/2835088946 wait complete. 2023-10-14T11:23:27.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.098+0000 7fbac53a7700 1 Processor -- start 2023-10-14T11:23:27.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.098+0000 7fbac53a7700 1 -- start start 2023-10-14T11:23:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbac00d06b0 0x7fbac00b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac015d9e0 0x7fbac01f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00cb880 con 0x7fbac00d4410 2023-10-14T11:23:27.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00cc400 con 0x7fbac015d9e0 2023-10-14T11:23:27.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac00cbad0 con 0x7fbac00d06b0 2023-10-14T11:23:27.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42202/0 (socket says 172.21.15.67:42202) 2023-10-14T11:23:27.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 -- 172.21.15.67:0/1965876644 learned_addr learned my addr 172.21.15.67:0/1965876644 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:27.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabeffd700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbac00d06b0 0x7fbac00b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabf7fe700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac015d9e0 0x7fbac01f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 -- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbac00d06b0 msgr2=0x7fbac00b5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbac00d06b0 0x7fbac00b5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 -- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac015d9e0 msgr2=0x7fbac01f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac015d9e0 0x7fbac01f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 -- 172.21.15.67:0/1965876644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8009b30 con 0x7fbac00d4410 2023-10-14T11:23:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbabe7fc700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c4b0 tx=0x7fbab000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00052d0 con 0x7fbac00d4410 2023-10-14T11:23:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab0005430 con 0x7fbac00d4410 2023-10-14T11:23:27.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac00cbdb0 con 0x7fbac00d4410 2023-10-14T11:23:27.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.099+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab00038c0 con 0x7fbac00d4410 2023-10-14T11:23:27.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.100+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac01f4160 con 0x7fbac00d4410 2023-10-14T11:23:27.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.101+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac00cbc10 con 0x7fbac00d4410 2023-10-14T11:23:27.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.101+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbab0003a20 con 0x7fbac00d4410 2023-10-14T11:23:27.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.101+0000 7fbaa77fe700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.101+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbab00888f0 con 0x7fbac00d4410 2023-10-14T11:23:27.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.102+0000 7fbabeffd700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.102+0000 7fbabeffd700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 0x7fbaac06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c940 tx=0x7fbab4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.106+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbac00cbc10 con 0x7fbac00d4410 2023-10-14T11:23:27.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.306+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbac00cbc10 con 0x7fbac00d4410 2023-10-14T11:23:27.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.306+0000 7fbaa77fe700 1 -- 172.21.15.67:0/1965876644 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbac00cbc10 con 0x7fbac00d4410 2023-10-14T11:23:27.308 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:27.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 msgr2=0x7fbaac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 0x7fbaac06d3c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbab400c940 tx=0x7fbab4008040 comp rx=0 tx=0).stop 2023-10-14T11:23:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 msgr2=0x7fbac01f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbab000c4b0 tx=0x7fbab000c7c0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 shutdown_connections 2023-10-14T11:23:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac015d9e0 0x7fbac01f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbac00d06b0 0x7fbac00b5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbaac06af00 0x7fbaac06d3c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 --2- 172.21.15.67:0/1965876644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbac00d4410 0x7fbac01f3c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 >> 172.21.15.67:0/1965876644 conn(0x7fbac008af10 msgr2=0x7fbac00b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:27.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 shutdown_connections 2023-10-14T11:23:27.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.308+0000 7fbac53a7700 1 -- 172.21.15.67:0/1965876644 wait complete. 2023-10-14T11:23:27.322 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:27.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 Processor -- start 2023-10-14T11:23:27.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 -- start start 2023-10-14T11:23:27.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e140b0bb0 0x7f7e140cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e140b1250 0x7f7e140b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140b0f90 con 0x7f7e1406b3b0 2023-10-14T11:23:27.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140cde00 con 0x7f7e140b0bb0 2023-10-14T11:23:27.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.449+0000 7f7e1ae80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140b1bc0 con 0x7f7e140b1250 2023-10-14T11:23:27.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e140b0bb0 0x7f7e140cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e140b0bb0 0x7f7e140cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42208/0 (socket says 172.21.15.67:42208) 2023-10-14T11:23:27.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 -- 172.21.15.67:0/3821966280 learned_addr learned my addr 172.21.15.67:0/3821966280 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:27.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e1941d700 1 --2- 172.21.15.67:0/3821966280 >> v2:172.21.15.72:3300/0 conn(0x7f7e140b1250 0x7f7e140b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 -- 172.21.15.67:0/3821966280 >> v2:172.21.15.72:3300/0 conn(0x7f7e140b1250 msgr2=0x7f7e140b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:27.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 --2- 172.21.15.67:0/3821966280 >> v2:172.21.15.72:3300/0 conn(0x7f7e140b1250 0x7f7e140b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 -- 172.21.15.67:0/3821966280 >> v1:172.21.15.72:6789/0 conn(0x7f7e1406b3b0 legacy=0x7f7e140cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 -- 172.21.15.67:0/3821966280 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140cc820 con 0x7f7e140b0bb0 2023-10-14T11:23:27.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e18c1c700 1 --2- 172.21.15.67:0/3821966280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e140b0bb0 0x7f7e140cd8c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e14161660 tx=0x7f7e08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696dc439a525d982 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e137fe700 1 -- 172.21.15.67:0/3821966280 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011830 con 0x7f7e140b0bb0 2023-10-14T11:23:27.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e137fe700 1 -- 172.21.15.67:0/3821966280 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08011990 con 0x7f7e140b0bb0 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.450+0000 7f7e137fe700 1 -- 172.21.15.67:0/3821966280 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08011d20 con 0x7f7e140b0bb0 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 -- 172.21.15.67:0/3821966280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e140b0bb0 msgr2=0x7f7e140cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/3821966280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e140b0bb0 0x7f7e140cd8c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e14161660 tx=0x7f7e08009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 -- 172.21.15.67:0/3821966280 shutdown_connections 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/3821966280 >> v2:172.21.15.72:3300/0 conn(0x7f7e140b1250 0x7f7e140b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/3821966280 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e140b0bb0 0x7f7e140cd8c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 -- 172.21.15.67:0/3821966280 >> 172.21.15.67:0/3821966280 conn(0x7f7e140d04b0 msgr2=0x7f7e140d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:27.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 -- 172.21.15.67:0/3821966280 shutdown_connections 2023-10-14T11:23:27.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.451+0000 7f7e1ae80700 1 -- 172.21.15.67:0/3821966280 wait complete. 2023-10-14T11:23:27.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.452+0000 7f7e1ae80700 1 Processor -- start 2023-10-14T11:23:27.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.452+0000 7f7e1ae80700 1 -- start start 2023-10-14T11:23:27.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e140b0bb0 0x7f7e1415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 0x7f7e140b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14153410 con 0x7f7e1406b3b0 2023-10-14T11:23:27.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140ad200 con 0x7f7e140b1250 2023-10-14T11:23:27.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1ae80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141f3270 con 0x7f7e140b0bb0 2023-10-14T11:23:27.462 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42214/0 (socket says 172.21.15.67:42214) 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 -- 172.21.15.67:0/1326340913 learned_addr learned my addr 172.21.15.67:0/1326340913 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e13fff700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e140b0bb0 0x7f7e1415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1941d700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 0x7f7e140b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 -- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e140b0bb0 msgr2=0x7f7e1415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.463 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e140b0bb0 0x7f7e1415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 -- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 msgr2=0x7f7e140b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 0x7f7e140b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e18c1c700 1 -- 172.21.15.67:0/1326340913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009550 con 0x7f7e1406b3b0 2023-10-14T11:23:27.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.453+0000 7f7e1941d700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 0x7f7e140b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:27.464 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e18c1c700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08004480 con 0x7f7e1406b3b0 2023-10-14T11:23:27.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0801f070 con 0x7f7e1406b3b0 2023-10-14T11:23:27.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140ad450 con 0x7f7e1406b3b0 2023-10-14T11:23:27.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e080038c0 con 0x7f7e1406b3b0 2023-10-14T11:23:27.465 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.454+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140ada10 con 0x7f7e1406b3b0 2023-10-14T11:23:27.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.455+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1404ebb0 con 0x7f7e1406b3b0 2023-10-14T11:23:27.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.455+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e08021030 con 0x7f7e1406b3b0 2023-10-14T11:23:27.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.456+0000 7f7e117fa700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 0x7f7df806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.456+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e0808a950 con 0x7f7e1406b3b0 2023-10-14T11:23:27.466 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.456+0000 7f7e13fff700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 0x7f7df806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.456+0000 7f7e13fff700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 0x7f7df806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e14161300 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.460+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e08055bb0 con 0x7f7e1406b3b0 2023-10-14T11:23:27.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.661+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e1406c710 con 0x7f7e1406b3b0 2023-10-14T11:23:27.663 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.661+0000 7f7e117fa700 1 -- 172.21.15.67:0/1326340913 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e080150a0 con 0x7f7e1406b3b0 2023-10-14T11:23:27.664 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:27.665 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 msgr2=0x7f7df806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 0x7f7df806d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e14161300 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2023-10-14T11:23:27.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 msgr2=0x7f7e141f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7e08000c00 tx=0x7f7e08004750 comp rx=0 tx=0).stop 2023-10-14T11:23:27.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 shutdown_connections 2023-10-14T11:23:27.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e140b1250 0x7f7e140b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7df806af00 0x7f7df806d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e1406b3b0 0x7f7e141f2d30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 --2- 172.21.15.67:0/1326340913 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e140b0bb0 0x7f7e1415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 >> 172.21.15.67:0/1326340913 conn(0x7f7e140d04b0 msgr2=0x7f7e140cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:27.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 shutdown_connections 2023-10-14T11:23:27.668 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.663+0000 7f7e1ae80700 1 -- 172.21.15.67:0/1326340913 wait complete. 2023-10-14T11:23:27.678 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:27.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.804+0000 7f7e2f852700 1 Processor -- start 2023-10-14T11:23:27.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.805+0000 7f7e2f852700 1 -- start start 2023-10-14T11:23:27.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.805+0000 7f7e2f852700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e280cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.805+0000 7f7e2f852700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280b0f90 con 0x7f7e280b1250 2023-10-14T11:23:27.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.805+0000 7f7e2f852700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280cc820 con 0x7f7e2806b3b0 2023-10-14T11:23:27.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.805+0000 7f7e2f852700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cde00 con 0x7f7e280b0bb0 2023-10-14T11:23:27.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2ddef700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7e280b1250 0x7f7e280cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41516/0 (socket says 172.21.15.67:41516) 2023-10-14T11:23:27.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2ddef700 1 -- 172.21.15.67:0/3077020192 learned_addr learned my addr 172.21.15.67:0/3077020192 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2d5ee700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e280cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756069859 0 0) 0x7f7e280b0f90 con 0x7f7e280b1250 2023-10-14T11:23:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e140035b0 con 0x7f7e280b1250 2023-10-14T11:23:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671225336 0 0) 0x7f7e280cc820 con 0x7f7e2806b3b0 2023-10-14T11:23:27.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e280b0f90 con 0x7f7e2806b3b0 2023-10-14T11:23:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1764847145 0 0) 0x7f7e140035b0 con 0x7f7e280b1250 2023-10-14T11:23:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 msgr2=0x7f7e280cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e280cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 >> v1:172.21.15.72:6789/0 conn(0x7f7e2806b3b0 legacy=0x7f7e280cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280ccb00 con 0x7f7e280b1250 2023-10-14T11:23:27.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f7e200019f0 con 0x7f7e280b1250 2023-10-14T11:23:27.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 >> v1:172.21.15.67:6789/0 conn(0x7f7e280b1250 legacy=0x7f7e280cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e14003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e14004120 0x7f7e14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e14004d90 0x7f7e14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cde00 con 0x7f7e14004d90 2023-10-14T11:23:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1400baf0 con 0x7f7e14004120 2023-10-14T11:23:27.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1400bcb0 con 0x7f7e280b0bb0 2023-10-14T11:23:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e14004d90 0x7f7e14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2d5ee700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e14003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.806+0000 7f7e2cded700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e14004120 0x7f7e14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 -- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 msgr2=0x7f7e14003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:27.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e280b0bb0 0x7f7e14003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 -- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e14004120 msgr2=0x7f7e14004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e14004120 0x7f7e14004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 -- 172.21.15.67:0/3077020192 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140035b0 con 0x7f7e14004d90 2023-10-14T11:23:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e14004d90 0x7f7e14005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000a7a0 tx=0x7f7e14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d071dc4a84a73356 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20012600 con 0x7f7e14004d90 2023-10-14T11:23:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20012780 con 0x7f7e14004d90 2023-10-14T11:23:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e1ffff700 1 -- 172.21.15.67:0/3077020192 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20012b30 con 0x7f7e14004d90 2023-10-14T11:23:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.807+0000 7f7e2f852700 1 -- 172.21.15.67:0/3077020192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e14004d90 msgr2=0x7f7e14005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2f852700 1 --2- 172.21.15.67:0/3077020192 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e14004d90 0x7f7e14005210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000a7a0 tx=0x7f7e14005880 comp rx=0 tx=0).stop 2023-10-14T11:23:27.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2ddef700 1 -- 172.21.15.67:0/3077020192 reap_dead start 2023-10-14T11:23:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2f852700 1 -- 172.21.15.67:0/3077020192 shutdown_connections 2023-10-14T11:23:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2f852700 1 -- 172.21.15.67:0/3077020192 >> 172.21.15.67:0/3077020192 conn(0x7f7e280d04b0 msgr2=0x7f7e280d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2f852700 1 -- 172.21.15.67:0/3077020192 shutdown_connections 2023-10-14T11:23:27.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.808+0000 7f7e2f852700 1 -- 172.21.15.67:0/3077020192 wait complete. 2023-10-14T11:23:27.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.809+0000 7f7e2f852700 1 Processor -- start 2023-10-14T11:23:27.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.809+0000 7f7e2f852700 1 -- start start 2023-10-14T11:23:27.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2806aa80 0x7f7e281f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e28151850 0x7f7e280ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281f7310 con 0x7f7e280aed20 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281f75f0 con 0x7f7e2806aa80 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2f852700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281f78d0 con 0x7f7e28151850 2023-10-14T11:23:27.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2ddef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2ddef700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42238/0 (socket says 172.21.15.67:42238) 2023-10-14T11:23:27.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.810+0000 7f7e2ddef700 1 -- 172.21.15.67:0/2288299225 learned_addr learned my addr 172.21.15.67:0/2288299225 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:27.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2d5ee700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2806aa80 0x7f7e281f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2cded700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e28151850 0x7f7e280ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 -- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e28151850 msgr2=0x7f7e280ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e28151850 0x7f7e280ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 -- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2806aa80 msgr2=0x7f7e281f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:27.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2806aa80 0x7f7e281f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:27.825 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 -- 172.21.15.67:0/2288299225 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280c8670 con 0x7f7e280aed20 2023-10-14T11:23:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2ddef700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e20015040 tx=0x7f7e20001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200019c0 con 0x7f7e280aed20 2023-10-14T11:23:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20027410 con 0x7f7e280aed20 2023-10-14T11:23:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20027800 con 0x7f7e280aed20 2023-10-14T11:23:27.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280c8950 con 0x7f7e280aed20 2023-10-14T11:23:27.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.811+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2806ae60 con 0x7f7e280aed20 2023-10-14T11:23:27.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.812+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e280c8b40 con 0x7f7e280aed20 2023-10-14T11:23:27.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.813+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e20019070 con 0x7f7e280aed20 2023-10-14T11:23:27.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.813+0000 7f7e1dffb700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 0x7f7e0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:27.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.813+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e2008aaf0 con 0x7f7e280aed20 2023-10-14T11:23:27.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.813+0000 7f7e2d5ee700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 0x7f7e0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:27.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.814+0000 7f7e2d5ee700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 0x7f7e0c06d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009c60 tx=0x7f7e24009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:27.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:27.818+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e20055cf0 con 0x7f7e280aed20 2023-10-14T11:23:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.019+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e2804ebb0 con 0x7f7e280aed20 2023-10-14T11:23:28.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.019+0000 7f7e1dffb700 1 -- 172.21.15.67:0/2288299225 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e200170a0 con 0x7f7e280aed20 2023-10-14T11:23:28.022 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 msgr2=0x7f7e0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 0x7f7e0c06d3c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009c60 tx=0x7f7e24009210 comp rx=0 tx=0).stop 2023-10-14T11:23:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 msgr2=0x7f7e280c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7e20015040 tx=0x7f7e20001d00 comp rx=0 tx=0).stop 2023-10-14T11:23:28.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 shutdown_connections 2023-10-14T11:23:28.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e0c06af00 0x7f7e0c06d3c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e280aed20 0x7f7e280c8e70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e2806aa80 0x7f7e281f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 --2- 172.21.15.67:0/2288299225 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e28151850 0x7f7e280ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.021+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 >> 172.21.15.67:0/2288299225 conn(0x7f7e280d04b0 msgr2=0x7f7e2806f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.022+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 shutdown_connections 2023-10-14T11:23:28.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.022+0000 7f7e2f852700 1 -- 172.21.15.67:0/2288299225 wait complete. 2023-10-14T11:23:28.045 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2023-10-14T11:23:28.045 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-10-14T11:23:28.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:28.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.169+0000 7f8c39053700 1 Processor -- start 2023-10-14T11:23:28.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.169+0000 7f8c39053700 1 -- start start 2023-10-14T11:23:28.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c39053700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c34072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c39053700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c34072ac0 con 0x7f8c3415e4a0 2023-10-14T11:23:28.175 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c39053700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340cfa80 con 0x7f8c340c52c0 2023-10-14T11:23:28.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c39053700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340cfd60 con 0x7f8c3415e0c0 2023-10-14T11:23:28.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c3259c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8c3415e4a0 0x7f8c340cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41538/0 (socket says 172.21.15.67:41538) 2023-10-14T11:23:28.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c3259c700 1 -- 172.21.15.67:0/4293599212 learned_addr learned my addr 172.21.15.67:0/4293599212 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:28.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c34072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165605315 0 0) 0x7f8c34072ac0 con 0x7f8c3415e4a0 2023-10-14T11:23:28.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.170+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c1c0035b0 con 0x7f8c3415e4a0 2023-10-14T11:23:28.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675502672 0 0) 0x7f8c1c0035b0 con 0x7f8c3415e4a0 2023-10-14T11:23:28.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 msgr2=0x7f8c34072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c34072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 >> v1:172.21.15.72:6789/0 conn(0x7f8c340c52c0 legacy=0x7f8c3406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c340d0040 con 0x7f8c3415e4a0 2023-10-14T11:23:28.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f8c24001670 con 0x7f8c3415e4a0 2023-10-14T11:23:28.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 >> v1:172.21.15.67:6789/0 conn(0x7f8c3415e4a0 legacy=0x7f8c340cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c1c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c1c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1c004d90 0x7f8c1c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340cfd60 con 0x7f8c1c003f70 2023-10-14T11:23:28.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c00ba70 con 0x7f8c1c004d90 2023-10-14T11:23:28.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c00bc30 con 0x7f8c3415e0c0 2023-10-14T11:23:28.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c1c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c1c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3359e700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1c004d90 0x7f8c1c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 -- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 msgr2=0x7f8c1c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c1c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 -- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1c004d90 msgr2=0x7f8c1c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1c004d90 0x7f8c1c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 -- 172.21.15.67:0/4293599212 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0035b0 con 0x7f8c1c003f70 2023-10-14T11:23:28.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c3415e0c0 0x7f8c1c003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3359e700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c1c004d90 0x7f8c1c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c3259c700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c1c004850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007f40 tx=0x7f8c1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8693951c6bf90553 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400cd40 con 0x7f8c1c003f70 2023-10-14T11:23:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24005960 con 0x7f8c1c003f70 2023-10-14T11:23:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.171+0000 7f8c31d9b700 1 -- 172.21.15.67:0/4293599212 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24005d10 con 0x7f8c1c003f70 2023-10-14T11:23:28.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 -- 172.21.15.67:0/4293599212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 msgr2=0x7f8c1c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 --2- 172.21.15.67:0/4293599212 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c1c004850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8c24007f40 tx=0x7f8c1c005880 comp rx=0 tx=0).stop 2023-10-14T11:23:28.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c3359e700 1 -- 172.21.15.67:0/4293599212 reap_dead start 2023-10-14T11:23:28.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 -- 172.21.15.67:0/4293599212 shutdown_connections 2023-10-14T11:23:28.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 -- 172.21.15.67:0/4293599212 >> 172.21.15.67:0/4293599212 conn(0x7f8c340d0440 msgr2=0x7f8c340d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 -- 172.21.15.67:0/4293599212 shutdown_connections 2023-10-14T11:23:28.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.172+0000 7f8c39053700 1 -- 172.21.15.67:0/4293599212 wait complete. 2023-10-14T11:23:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 Processor -- start 2023-10-14T11:23:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 -- start start 2023-10-14T11:23:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 0x7f8c341536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.187 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c34153c00 0x7f8c340c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c341487b0 con 0x7f8c1c003f70 2023-10-14T11:23:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c341f2890 con 0x7f8c34153c00 2023-10-14T11:23:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c39053700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34154110 con 0x7f8c340b1900 2023-10-14T11:23:28.188 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c32d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c32d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42256/0 (socket says 172.21.15.67:42256) 2023-10-14T11:23:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.174+0000 7f8c32d9d700 1 -- 172.21.15.67:0/1391445358 learned_addr learned my addr 172.21.15.67:0/1391445358 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c3359e700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c34153c00 0x7f8c340c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c3259c700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 0x7f8c341536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.189 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 -- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 msgr2=0x7f8c341536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 0x7f8c341536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 -- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c34153c00 msgr2=0x7f8c340c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c34153c00 0x7f8c340c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 -- 172.21.15.67:0/1391445358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c341f2240 con 0x7f8c1c003f70 2023-10-14T11:23:28.190 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c3259c700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 0x7f8c341536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c32d9d700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c280118d0 tx=0x7f8c28011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28004220 con 0x7f8c1c003f70 2023-10-14T11:23:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28004380 con 0x7f8c1c003f70 2023-10-14T11:23:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c341f2520 con 0x7f8c1c003f70 2023-10-14T11:23:28.191 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280036a0 con 0x7f8c1c003f70 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.175+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c340b1d80 con 0x7f8c1c003f70 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.176+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c341f2b70 con 0x7f8c1c003f70 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.177+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c28003820 con 0x7f8c1c003f70 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.177+0000 7f8c1b7fe700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 0x7f8c2006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.177+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c28089a00 con 0x7f8c1c003f70 2023-10-14T11:23:28.192 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.177+0000 7f8c3259c700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 0x7f8c2006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.178+0000 7f8c3259c700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 0x7f8c2006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c24014040 tx=0x7f8c24007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.193 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.182+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c28054ab0 con 0x7f8c1c003f70 2023-10-14T11:23:28.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.383+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c3404ebb0 con 0x7f8c1c003f70 2023-10-14T11:23:28.386 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.384+0000 7f8c1b7fe700 1 -- 172.21.15.67:0/1391445358 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8c28022090 con 0x7f8c1c003f70 2023-10-14T11:23:28.386 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:28.386 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:28.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 msgr2=0x7f8c2006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 0x7f8c2006d3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c24014040 tx=0x7f8c24007000 comp rx=0 tx=0).stop 2023-10-14T11:23:28.388 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 msgr2=0x7f8c341f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8c280118d0 tx=0x7f8c28011be0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 shutdown_connections 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c34153c00 0x7f8c340c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8c2006af00 0x7f8c2006d3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8c1c003f70 0x7f8c341f2d20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.389 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 --2- 172.21.15.67:0/1391445358 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8c340b1900 0x7f8c341536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 >> 172.21.15.67:0/1391445358 conn(0x7f8c340d0440 msgr2=0x7f8c3415bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 shutdown_connections 2023-10-14T11:23:28.390 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.386+0000 7f8c39053700 1 -- 172.21.15.67:0/1391445358 wait complete. 2023-10-14T11:23:28.400 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:28.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:28.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.527+0000 7ff6d4e67700 1 Processor -- start 2023-10-14T11:23:28.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.527+0000 7ff6d4e67700 1 -- start start 2023-10-14T11:23:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6d4e67700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff6d006b3b0 0x7ff6d00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6d4e67700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff6d00b1250 0x7ff6d00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6d4e67700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d00b0f90 con 0x7ff6d00b0bb0 2023-10-14T11:23:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6d4e67700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d00cde00 con 0x7ff6d00b1250 2023-10-14T11:23:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6d4e67700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d00b1bc0 con 0x7ff6d006b3b0 2023-10-14T11:23:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6ced9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff6d00b1250 0x7ff6d00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6ce59c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff6d00b0bb0 0x7ff6d00cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41556/0 (socket says 172.21.15.67:41556) 2023-10-14T11:23:28.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6ced9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff6d00b1250 0x7ff6d00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42266/0 (socket says 172.21.15.67:42266) 2023-10-14T11:23:28.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6ce59c700 1 -- 172.21.15.67:0/1349378573 learned_addr learned my addr 172.21.15.67:0/1349378573 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:28.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.528+0000 7ff6cdd9b700 1 --2- 172.21.15.67:0/1349378573 >> v2:172.21.15.72:3300/0 conn(0x7ff6d006b3b0 0x7ff6d00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6ced9d700 1 -- 172.21.15.67:0/1349378573 >> v2:172.21.15.72:3300/0 conn(0x7ff6d006b3b0 msgr2=0x7ff6d00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6ced9d700 1 --2- 172.21.15.67:0/1349378573 >> v2:172.21.15.72:3300/0 conn(0x7ff6d006b3b0 0x7ff6d00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6ced9d700 1 -- 172.21.15.67:0/1349378573 >> v1:172.21.15.67:6789/0 conn(0x7ff6d00b0bb0 legacy=0x7ff6d00cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6ced9d700 1 -- 172.21.15.67:0/1349378573 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d00cc820 con 0x7ff6d00b1250 2023-10-14T11:23:28.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6cd59a700 1 -- 172.21.15.67:0/1349378573 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803261976 0 0) 0x7ff6d00b0f90 con 0x7ff6d00b0bb0 2023-10-14T11:23:28.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6ced9d700 1 --2- 172.21.15.67:0/1349378573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d00b1250 0x7ff6d00b1680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00cdfa0 tx=0x7ff6c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8961764815b56146 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6cd59a700 1 -- 172.21.15.67:0/1349378573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800e070 con 0x7ff6d00b1250 2023-10-14T11:23:28.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6cd59a700 1 -- 172.21.15.67:0/1349378573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c800bb20 con 0x7ff6d00b1250 2023-10-14T11:23:28.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6cd59a700 1 -- 172.21.15.67:0/1349378573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8012430 con 0x7ff6d00b1250 2023-10-14T11:23:28.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1349378573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d00b1250 msgr2=0x7ff6d00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.529+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1349378573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d00b1250 0x7ff6d00b1680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00cdfa0 tx=0x7ff6c800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:28.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1349378573 shutdown_connections 2023-10-14T11:23:28.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1349378573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d00b1250 0x7ff6d00b1680 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1349378573 >> v2:172.21.15.72:3300/0 conn(0x7ff6d006b3b0 0x7ff6d00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1349378573 >> 172.21.15.67:0/1349378573 conn(0x7ff6d00d04b0 msgr2=0x7ff6d00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1349378573 shutdown_connections 2023-10-14T11:23:28.537 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.530+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1349378573 wait complete. 2023-10-14T11:23:28.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.531+0000 7ff6d4e67700 1 Processor -- start 2023-10-14T11:23:28.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.531+0000 7ff6d4e67700 1 -- start start 2023-10-14T11:23:28.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 0x7ff6d00c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6d00b1250 0x7ff6d015ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d015b350 con 0x7ff6d006b3b0 2023-10-14T11:23:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c6ad0 con 0x7ff6d00b0bb0 2023-10-14T11:23:28.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d00c67f0 con 0x7ff6d00b1250 2023-10-14T11:23:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42268/0 (socket says 172.21.15.67:42268) 2023-10-14T11:23:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 -- 172.21.15.67:0/1319180457 learned_addr learned my addr 172.21.15.67:0/1319180457 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ced9d700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6d00b1250 0x7ff6d015ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6cdd9b700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 0x7ff6d00c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 -- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6d00b1250 msgr2=0x7ff6d015ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6d00b1250 0x7ff6d015ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 -- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 msgr2=0x7ff6d00c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 0x7ff6d00c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 -- 172.21.15.67:0/1319180457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009a70 con 0x7ff6d006b3b0 2023-10-14T11:23:28.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6cdd9b700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 0x7ff6d00c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6ce59c700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40011e0 tx=0x7ff6c400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004c80 con 0x7ff6d006b3b0 2023-10-14T11:23:28.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4004de0 con 0x7ff6d006b3b0 2023-10-14T11:23:28.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d00c4b20 con 0x7ff6d006b3b0 2023-10-14T11:23:28.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4007310 con 0x7ff6d006b3b0 2023-10-14T11:23:28.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.532+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d00c50e0 con 0x7ff6d006b3b0 2023-10-14T11:23:28.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.533+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d00c5300 con 0x7ff6d006b3b0 2023-10-14T11:23:28.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.534+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6c4007470 con 0x7ff6d006b3b0 2023-10-14T11:23:28.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.534+0000 7ff6beffd700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 0x7ff6b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.534+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c4089220 con 0x7ff6d006b3b0 2023-10-14T11:23:28.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.534+0000 7ff6cdd9b700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 0x7ff6b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.535+0000 7ff6cdd9b700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 0x7ff6b006d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00d12e0 tx=0x7ff6c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.546 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.539+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6c4054360 con 0x7ff6d006b3b0 2023-10-14T11:23:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.739+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6d004ebb0 con 0x7ff6d006b3b0 2023-10-14T11:23:28.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.740+0000 7ff6beffd700 1 -- 172.21.15.67:0/1319180457 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6c4057980 con 0x7ff6d006b3b0 2023-10-14T11:23:28.742 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 msgr2=0x7ff6b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 0x7ff6b006d3c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00d12e0 tx=0x7ff6c0008040 comp rx=0 tx=0).stop 2023-10-14T11:23:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 msgr2=0x7ff6d015b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40011e0 tx=0x7ff6c400ca30 comp rx=0 tx=0).stop 2023-10-14T11:23:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 shutdown_connections 2023-10-14T11:23:28.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff6d00b1250 0x7ff6d015ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff6b006af00 0x7ff6b006d3c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff6d006b3b0 0x7ff6d015b510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 --2- 172.21.15.67:0/1319180457 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6d00b0bb0 0x7ff6d00c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 >> 172.21.15.67:0/1319180457 conn(0x7ff6d00d04b0 msgr2=0x7ff6d006f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 shutdown_connections 2023-10-14T11:23:28.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.742+0000 7ff6d4e67700 1 -- 172.21.15.67:0/1319180457 wait complete. 2023-10-14T11:23:28.756 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.882+0000 7f6740e09700 1 Processor -- start 2023-10-14T11:23:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 -- start start 2023-10-14T11:23:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f673c0b0bb0 0x7f673c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c06b3b0 0x7f673c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 0x7f673c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0cde00 con 0x7f673c0b0bb0 2023-10-14T11:23:28.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c0b0f90 con 0x7f673c0cfeb0 2023-10-14T11:23:28.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.883+0000 7f6740e09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c0cc820 con 0x7f673c06b3b0 2023-10-14T11:23:28.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f673c0b0bb0 0x7f673c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f673c0b0bb0 0x7f673c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42276/0 (socket says 172.21.15.67:42276) 2023-10-14T11:23:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 -- 172.21.15.67:0/1682468889 learned_addr learned my addr 172.21.15.67:0/1682468889 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f6739d9b700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c06b3b0 0x7f673c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673ad9d700 1 --2- 172.21.15.67:0/1682468889 >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 0x7f673c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 -- 172.21.15.67:0/1682468889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c06b3b0 msgr2=0x7f673c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c06b3b0 0x7f673c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 -- 172.21.15.67:0/1682468889 >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 msgr2=0x7f673c0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:28.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 --2- 172.21.15.67:0/1682468889 >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 0x7f673c0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 -- 172.21.15.67:0/1682468889 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0ccb00 con 0x7f673c0b0bb0 2023-10-14T11:23:28.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673ad9d700 1 --2- 172.21.15.67:0/1682468889 >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 0x7f673c0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673a59c700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c0b0bb0 0x7f673c0cd8c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f673c0713c0 tx=0x7f672c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4ee4a061d00ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673959a700 1 -- 172.21.15.67:0/1682468889 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c011830 con 0x7f673c0b0bb0 2023-10-14T11:23:28.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673959a700 1 -- 172.21.15.67:0/1682468889 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c011990 con 0x7f673c0b0bb0 2023-10-14T11:23:28.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.884+0000 7f673959a700 1 -- 172.21.15.67:0/1682468889 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c011d20 con 0x7f673c0b0bb0 2023-10-14T11:23:28.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 -- 172.21.15.67:0/1682468889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c0b0bb0 msgr2=0x7f673c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c0b0bb0 0x7f673c0cd8c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f673c0713c0 tx=0x7f672c009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 -- 172.21.15.67:0/1682468889 shutdown_connections 2023-10-14T11:23:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 --2- 172.21.15.67:0/1682468889 >> v2:172.21.15.72:3300/0 conn(0x7f673c0cfeb0 0x7f673c0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c0b0bb0 0x7f673c0cd8c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 --2- 172.21.15.67:0/1682468889 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c06b3b0 0x7f673c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 -- 172.21.15.67:0/1682468889 >> 172.21.15.67:0/1682468889 conn(0x7f673c0d04b0 msgr2=0x7f673c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 -- 172.21.15.67:0/1682468889 shutdown_connections 2023-10-14T11:23:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.885+0000 7f6740e09700 1 -- 172.21.15.67:0/1682468889 wait complete. 2023-10-14T11:23:28.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.886+0000 7f6740e09700 1 Processor -- start 2023-10-14T11:23:28.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.886+0000 7f6740e09700 1 -- start start 2023-10-14T11:23:28.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 0x7f673c06ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 0x7f673c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c15fe20 con 0x7f673c06b3b0 2023-10-14T11:23:28.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c160100 con 0x7f673c0cfeb0 2023-10-14T11:23:28.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6740e09700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c1603e0 con 0x7f673c0b0bb0 2023-10-14T11:23:28.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42280/0 (socket says 172.21.15.67:42280) 2023-10-14T11:23:28.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 -- 172.21.15.67:0/906952487 learned_addr learned my addr 172.21.15.67:0/906952487 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:28.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f6739d9b700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 0x7f673c06ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673ad9d700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 0x7f673c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 -- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 msgr2=0x7f673c06ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 0x7f673c06ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 -- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 msgr2=0x7f673c14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:28.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 0x7f673c14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:28.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.887+0000 7f673a59c700 1 -- 172.21.15.67:0/906952487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009550 con 0x7f673c06b3b0 2023-10-14T11:23:28.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6739d9b700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 0x7f673c06ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f673ad9d700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 0x7f673c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:28.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f673a59c700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f672c000c00 tx=0x7f672c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c004380 con 0x7f673c06b3b0 2023-10-14T11:23:28.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c01f070 con 0x7f673c06b3b0 2023-10-14T11:23:28.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c1606c0 con 0x7f673c06b3b0 2023-10-14T11:23:28.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0036a0 con 0x7f673c06b3b0 2023-10-14T11:23:28.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.888+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c15fa60 con 0x7f673c06b3b0 2023-10-14T11:23:28.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.889+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c04ebb0 con 0x7f673c06b3b0 2023-10-14T11:23:28.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.889+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f672c021030 con 0x7f673c06b3b0 2023-10-14T11:23:28.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.890+0000 7f6732ffd700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 0x7f671c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:28.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.890+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f672c08aa90 con 0x7f673c06b3b0 2023-10-14T11:23:28.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.890+0000 7f6739d9b700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 0x7f671c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:28.903 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.890+0000 7f6739d9b700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 0x7f671c06d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6724009b10 tx=0x7f6724008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:28.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:28.894+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f672c055b50 con 0x7f673c06b3b0 2023-10-14T11:23:29.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.094+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f673c071ea0 con 0x7f673c06b3b0 2023-10-14T11:23:29.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.095+0000 7f6732ffd700 1 -- 172.21.15.67:0/906952487 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f672c059170 con 0x7f673c06b3b0 2023-10-14T11:23:29.097 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:29.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 msgr2=0x7f671c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 0x7f671c06d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6724009b10 tx=0x7f6724008040 comp rx=0 tx=0).stop 2023-10-14T11:23:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 msgr2=0x7f673c15f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f672c000c00 tx=0x7f672c004750 comp rx=0 tx=0).stop 2023-10-14T11:23:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 shutdown_connections 2023-10-14T11:23:29.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f673c0cfeb0 0x7f673c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f671c06af00 0x7f671c06d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f673c06b3b0 0x7f673c15f520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 --2- 172.21.15.67:0/906952487 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f673c0b0bb0 0x7f673c06ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 >> 172.21.15.67:0/906952487 conn(0x7f673c0d04b0 msgr2=0x7f673c0b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:29.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 shutdown_connections 2023-10-14T11:23:29.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.097+0000 7f6740e09700 1 -- 172.21.15.67:0/906952487 wait complete. 2023-10-14T11:23:29.112 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:29.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.238+0000 7fc6b6a5f700 1 Processor -- start 2023-10-14T11:23:29.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.238+0000 7fc6b6a5f700 1 -- start start 2023-10-14T11:23:29.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b6a5f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6b00b4180 0x7fc6b00d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b6a5f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b00b2cc0 con 0x7fc6b00d0090 2023-10-14T11:23:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b6a5f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b0161520 con 0x7fc6b00b25a0 2023-10-14T11:23:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b6a5f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00d2860 con 0x7fc6b00b4180 2023-10-14T11:23:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b4ffc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6b00b4180 0x7fc6b00d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6affff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc6b00d0090 0x7fc6b00d2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41582/0 (socket says 172.21.15.67:41582) 2023-10-14T11:23:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b4ffc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc6b00b4180 0x7fc6b00d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42292/0 (socket says 172.21.15.67:42292) 2023-10-14T11:23:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6affff700 1 -- 172.21.15.67:0/4209426110 learned_addr learned my addr 172.21.15.67:0/4209426110 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b4ffc700 1 -- 172.21.15.67:0/4209426110 >> v1:172.21.15.72:6789/0 conn(0x7fc6b00b25a0 legacy=0x7fc6b00b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b4ffc700 1 -- 172.21.15.67:0/4209426110 >> v1:172.21.15.67:6789/0 conn(0x7fc6b00d0090 legacy=0x7fc6b00d2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6aeffd700 1 -- 172.21.15.67:0/4209426110 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239757064 0 0) 0x7fc6b00b2cc0 con 0x7fc6b00d0090 2023-10-14T11:23:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.239+0000 7fc6b4ffc700 1 -- 172.21.15.67:0/4209426110 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00cfad0 con 0x7fc6b00b4180 2023-10-14T11:23:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b4ffc700 1 --2- 172.21.15.67:0/4209426110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b00d0470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009d90 tx=0x7fc6a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e49b0515689098e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6aeffd700 1 -- 172.21.15.67:0/4209426110 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800e070 con 0x7fc6b00b4180 2023-10-14T11:23:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6aeffd700 1 -- 172.21.15.67:0/4209426110 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800bbd0 con 0x7fc6b00b4180 2023-10-14T11:23:29.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6aeffd700 1 -- 172.21.15.67:0/4209426110 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8012430 con 0x7fc6b00b4180 2023-10-14T11:23:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/4209426110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 msgr2=0x7fc6b00d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/4209426110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b00d0470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009d90 tx=0x7fc6a800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/4209426110 shutdown_connections 2023-10-14T11:23:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/4209426110 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b00d0470 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/4209426110 >> 172.21.15.67:0/4209426110 conn(0x7fc6b009cb00 msgr2=0x7fc6b00d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:29.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/4209426110 shutdown_connections 2023-10-14T11:23:29.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.240+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/4209426110 wait complete. 2023-10-14T11:23:29.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.242+0000 7fc6b6a5f700 1 Processor -- start 2023-10-14T11:23:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.242+0000 7fc6b6a5f700 1 -- start start 2023-10-14T11:23:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b00b25a0 0x7fc6b00b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 0x7fc6b015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00b91e0 con 0x7fc6b00b4180 2023-10-14T11:23:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01f6e90 con 0x7fc6b00b25a0 2023-10-14T11:23:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6b6a5f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b01f7170 con 0x7fc6b00d0090 2023-10-14T11:23:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42296/0 (socket says 172.21.15.67:42296) 2023-10-14T11:23:29.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.243+0000 7fc6af7fe700 1 -- 172.21.15.67:0/1698824573 learned_addr learned my addr 172.21.15.67:0/1698824573 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:29.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6b4ffc700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 0x7fc6b015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6affff700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b00b25a0 0x7fc6b00b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 -- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 msgr2=0x7fc6b015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 0x7fc6b015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 -- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b00b25a0 msgr2=0x7fc6b00b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b00b25a0 0x7fc6b00b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 -- 172.21.15.67:0/1698824573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009a70 con 0x7fc6b00b4180 2023-10-14T11:23:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6b4ffc700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 0x7fc6b015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6af7fe700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c4d0 tx=0x7fc6a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00052d0 con 0x7fc6b00b4180 2023-10-14T11:23:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0005430 con 0x7fc6b00b4180 2023-10-14T11:23:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b01f7450 con 0x7fc6b00b4180 2023-10-14T11:23:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0003880 con 0x7fc6b00b4180 2023-10-14T11:23:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.244+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b00b7b40 con 0x7fc6b00b4180 2023-10-14T11:23:29.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.245+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b004ebb0 con 0x7fc6b00b4180 2023-10-14T11:23:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.246+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc6a00039e0 con 0x7fc6b00b4180 2023-10-14T11:23:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.246+0000 7fc6acff9700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 0x7fc69006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.246+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6a00888a0 con 0x7fc6b00b4180 2023-10-14T11:23:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.247+0000 7fc6affff700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 0x7fc69006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.247+0000 7fc6affff700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 0x7fc69006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc698000f60 tx=0x7fc698007d90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.251+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6a0053a90 con 0x7fc6b00b4180 2023-10-14T11:23:29.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.453+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6b00b3e60 con 0x7fc6b00b4180 2023-10-14T11:23:29.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.453+0000 7fc6acff9700 1 -- 172.21.15.67:0/1698824573 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6a00170a0 con 0x7fc6b00b4180 2023-10-14T11:23:29.458 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:29.458 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 msgr2=0x7fc69006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 0x7fc69006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc698000f60 tx=0x7fc698007d90 comp rx=0 tx=0).stop 2023-10-14T11:23:29.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 msgr2=0x7fc6b01f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000c4d0 tx=0x7fc6a000c890 comp rx=0 tx=0).stop 2023-10-14T11:23:29.459 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 shutdown_connections 2023-10-14T11:23:29.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc6b00d0090 0x7fc6b015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6b00b25a0 0x7fc6b00b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc69006af00 0x7fc69006d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 --2- 172.21.15.67:0/1698824573 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc6b00b4180 0x7fc6b01f2c70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.460 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 >> 172.21.15.67:0/1698824573 conn(0x7fc6b009cb00 msgr2=0x7fc6b00d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:29.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 shutdown_connections 2023-10-14T11:23:29.461 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.455+0000 7fc6b6a5f700 1 -- 172.21.15.67:0/1698824573 wait complete. 2023-10-14T11:23:29.470 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-10-14T11:23:29.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.593+0000 7fc3cfe71700 1 Processor -- start 2023-10-14T11:23:29.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.593+0000 7fc3cfe71700 1 -- start start 2023-10-14T11:23:29.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cfe71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cfe71700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3c80cfe80 0x7fc3c80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cfe71700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c806cdd0 con 0x7fc3c81618d0 2023-10-14T11:23:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cfe71700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c806c1c0 con 0x7fc3c80cfe80 2023-10-14T11:23:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cfe71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c806c4a0 con 0x7fc3c815def0 2023-10-14T11:23:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cd40c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3c80cfe80 0x7fc3c80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3cdc0d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3ce40e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc3c81618d0 0x7fc3c815f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48422/0 (socket says 172.21.15.67:48422) 2023-10-14T11:23:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.594+0000 7fc3ce40e700 1 -- 172.21.15.67:0/55588134 learned_addr learned my addr 172.21.15.67:0/55588134 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/55588134 >> v2:172.21.15.72:3300/0 conn(0x7fc3c80cfe80 msgr2=0x7fc3c80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:29.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3cdc0d700 1 --2- 172.21.15.67:0/55588134 >> v2:172.21.15.72:3300/0 conn(0x7fc3c80cfe80 0x7fc3c80d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3ccc0b700 1 -- 172.21.15.67:0/55588134 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581807360 0 0) 0x7fc3c806cdd0 con 0x7fc3c81618d0 2023-10-14T11:23:29.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/55588134 >> v1:172.21.15.72:6789/0 conn(0x7fc3c81618d0 legacy=0x7fc3c815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/55588134 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c806c780 con 0x7fc3c815def0 2023-10-14T11:23:29.600 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3cdc0d700 1 --2- 172.21.15.67:0/55588134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c806d260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009840 tx=0x7fc3b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7f00d6f826a1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3ccc0b700 1 -- 172.21.15.67:0/55588134 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011830 con 0x7fc3c815def0 2023-10-14T11:23:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3ccc0b700 1 -- 172.21.15.67:0/55588134 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8011990 con 0x7fc3c815def0 2023-10-14T11:23:29.601 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.595+0000 7fc3ccc0b700 1 -- 172.21.15.67:0/55588134 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8011d20 con 0x7fc3c815def0 2023-10-14T11:23:29.604 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 -- 172.21.15.67:0/55588134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 msgr2=0x7fc3c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/55588134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c806d260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009840 tx=0x7fc3b8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 -- 172.21.15.67:0/55588134 shutdown_connections 2023-10-14T11:23:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/55588134 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c806d260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.605 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/55588134 >> v2:172.21.15.72:3300/0 conn(0x7fc3c80cfe80 0x7fc3c80d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 -- 172.21.15.67:0/55588134 >> 172.21.15.67:0/55588134 conn(0x7fc3c80d1570 msgr2=0x7fc3c80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 -- 172.21.15.67:0/55588134 shutdown_connections 2023-10-14T11:23:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.596+0000 7fc3cfe71700 1 -- 172.21.15.67:0/55588134 wait complete. 2023-10-14T11:23:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.597+0000 7fc3cfe71700 1 Processor -- start 2023-10-14T11:23:29.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.597+0000 7fc3cfe71700 1 -- start start 2023-10-14T11:23:29.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3c81618d0 0x7fc3c8160720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c815fd60 con 0x7fc3c80cfe80 2023-10-14T11:23:29.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c69c0 con 0x7fc3c81618d0 2023-10-14T11:23:29.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cfe71700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c60f0 con 0x7fc3c815def0 2023-10-14T11:23:29.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42308/0 (socket says 172.21.15.67:42308) 2023-10-14T11:23:29.608 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/2412191237 learned_addr learned my addr 172.21.15.67:0/2412191237 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:29.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3ce40e700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3c81618d0 0x7fc3c8160720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cd40c700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 msgr2=0x7fc3c8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c8156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3c81618d0 msgr2=0x7fc3c8160720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:29.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3c81618d0 0x7fc3c8160720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:29.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 -- 172.21.15.67:0/2412191237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b80094a0 con 0x7fc3c80cfe80 2023-10-14T11:23:29.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.598+0000 7fc3cdc0d700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009fd0 tx=0x7fc3b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80036a0 con 0x7fc3c80cfe80 2023-10-14T11:23:29.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b801f070 con 0x7fc3c80cfe80 2023-10-14T11:23:29.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c81566b0 con 0x7fc3c80cfe80 2023-10-14T11:23:29.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8003a20 con 0x7fc3c80cfe80 2023-10-14T11:23:29.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80c6300 con 0x7fc3c80cfe80 2023-10-14T11:23:29.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.599+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c804ebb0 con 0x7fc3c80cfe80 2023-10-14T11:23:29.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.600+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc3b8003b80 con 0x7fc3c80cfe80 2023-10-14T11:23:29.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.600+0000 7fc3be7fc700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 0x7fc3ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:29.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.601+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b8021070 con 0x7fc3c80cfe80 2023-10-14T11:23:29.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.601+0000 7fc3cd40c700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 0x7fc3ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:29.612 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.601+0000 7fc3cd40c700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 0x7fc3ac06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b5af0 tx=0x7fc3c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:29.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.605+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc3b8055f80 con 0x7fc3c80cfe80 2023-10-14T11:23:29.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:29.887+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7fc3c8067320 con 0x7fc3c80cfe80 2023-10-14T11:23:30.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.737+0000 7fc3be7fc700 1 -- 172.21.15.67:0/2412191237 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v48) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc3b802b020 con 0x7fc3c80cfe80 2023-10-14T11:23:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.740+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 msgr2=0x7fc3ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.740+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 0x7fc3ac06d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80b5af0 tx=0x7fc3c4008040 comp rx=0 tx=0).stop 2023-10-14T11:23:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.740+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 msgr2=0x7fc3c81f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.740+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009fd0 tx=0x7fc3b8004750 comp rx=0 tx=0).stop 2023-10-14T11:23:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 shutdown_connections 2023-10-14T11:23:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3c81618d0 0x7fc3c8160720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc3ac06af00 0x7fc3ac06d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc3c80cfe80 0x7fc3c81f4450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 --2- 172.21.15.67:0/2412191237 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc3c815def0 0x7fc3c8156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 >> 172.21.15.67:0/2412191237 conn(0x7fc3c80d1570 msgr2=0x7fc3c80afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 shutdown_connections 2023-10-14T11:23:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.741+0000 7fc3cfe71700 1 -- 172.21.15.67:0/2412191237 wait complete. 2023-10-14T11:23:30.758 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T11:23:30.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.891+0000 7fdab25a2700 1 Processor -- start 2023-10-14T11:23:30.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.891+0000 7fdab25a2700 1 -- start start 2023-10-14T11:23:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab25a2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaac0b1960 0x7fdaac0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab25a2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0b0f90 con 0x7fdaac06b3b0 2023-10-14T11:23:30.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab25a2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac0cc820 con 0x7fdaac0b0bb0 2023-10-14T11:23:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab25a2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0cde00 con 0x7fdaac0b1960 2023-10-14T11:23:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaac0b1960 0x7fdaac0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdaac0b1960 0x7fdaac0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42320/0 (socket says 172.21.15.67:42320) 2023-10-14T11:23:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdaab7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdaac06b3b0 0x7fdaac0b1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41612/0 (socket says 172.21.15.67:41612) 2023-10-14T11:23:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 -- 172.21.15.67:0/867093633 learned_addr learned my addr 172.21.15.67:0/867093633 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 -- 172.21.15.67:0/867093633 >> v1:172.21.15.72:6789/0 conn(0x7fdaac0b0bb0 legacy=0x7fdaac0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 -- 172.21.15.67:0/867093633 >> v1:172.21.15.67:6789/0 conn(0x7fdaac06b3b0 legacy=0x7fdaac0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 -- 172.21.15.67:0/867093633 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0ccb00 con 0x7fdaac0b1960 2023-10-14T11:23:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdaaaffd700 1 -- 172.21.15.67:0/867093633 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834484527 0 0) 0x7fdaac0b0f90 con 0x7fdaac06b3b0 2023-10-14T11:23:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.892+0000 7fdab0b3f700 1 --2- 172.21.15.67:0/867093633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac0b1960 0x7fdaac0cd8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009e50 tx=0x7fdaa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18030c7680429809 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdaaaffd700 1 -- 172.21.15.67:0/867093633 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400e070 con 0x7fdaac0b1960 2023-10-14T11:23:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdaaaffd700 1 -- 172.21.15.67:0/867093633 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa400b9c0 con 0x7fdaac0b1960 2023-10-14T11:23:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdaaaffd700 1 -- 172.21.15.67:0/867093633 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400bd70 con 0x7fdaac0b1960 2023-10-14T11:23:30.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 -- 172.21.15.67:0/867093633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac0b1960 msgr2=0x7fdaac0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 --2- 172.21.15.67:0/867093633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac0b1960 0x7fdaac0cd8c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009e50 tx=0x7fdaa400b330 comp rx=0 tx=0).stop 2023-10-14T11:23:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 -- 172.21.15.67:0/867093633 shutdown_connections 2023-10-14T11:23:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 --2- 172.21.15.67:0/867093633 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac0b1960 0x7fdaac0cd8c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 -- 172.21.15.67:0/867093633 >> 172.21.15.67:0/867093633 conn(0x7fdaac0d04b0 msgr2=0x7fdaac0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:30.900 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 -- 172.21.15.67:0/867093633 shutdown_connections 2023-10-14T11:23:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.893+0000 7fdab25a2700 1 -- 172.21.15.67:0/867093633 wait complete. 2023-10-14T11:23:30.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.894+0000 7fdab25a2700 1 Processor -- start 2023-10-14T11:23:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 -- start start 2023-10-14T11:23:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdaac0b0bb0 0x7fdaac14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdaac0b1960 0x7fdaac0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac14c350 con 0x7fdaac06b3b0 2023-10-14T11:23:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0ca320 con 0x7fdaac0b0bb0 2023-10-14T11:23:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdab25a2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c78b0 con 0x7fdaac0b1960 2023-10-14T11:23:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.895+0000 7fdaabfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42322/0 (socket says 172.21.15.67:42322) 2023-10-14T11:23:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 -- 172.21.15.67:0/3060199102 learned_addr learned my addr 172.21.15.67:0/3060199102 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaab7fe700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdaac0b0bb0 0x7fdaac14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:30.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdab0b3f700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdaac0b1960 0x7fdaac0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 -- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdaac0b1960 msgr2=0x7fdaac0b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdaac0b1960 0x7fdaac0b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 -- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdaac0b0bb0 msgr2=0x7fdaac14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdaac0b0bb0 0x7fdaac14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:30.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 -- 172.21.15.67:0/3060199102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009b30 con 0x7fdaac06b3b0 2023-10-14T11:23:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaabfff700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c500 tx=0x7fda9400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940052d0 con 0x7fdaac06b3b0 2023-10-14T11:23:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94005430 con 0x7fdaac06b3b0 2023-10-14T11:23:30.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac0c5220 con 0x7fdaac06b3b0 2023-10-14T11:23:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940038e0 con 0x7fdaac06b3b0 2023-10-14T11:23:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.896+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac0c57e0 con 0x7fdaac06b3b0 2023-10-14T11:23:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.897+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac04ebb0 con 0x7fdaac06b3b0 2023-10-14T11:23:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.898+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda94003a40 con 0x7fdaac06b3b0 2023-10-14T11:23:30.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.898+0000 7fdaa8ff9700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 0x7fda8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.898+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda94088950 con 0x7fdaac06b3b0 2023-10-14T11:23:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.898+0000 7fdaab7fe700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 0x7fda8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:30.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.899+0000 7fdaab7fe700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 0x7fda8c06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007b10 tx=0x7fda9c007a60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:30.903+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda94053a10 con 0x7fdaac06b3b0 2023-10-14T11:23:31.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.102+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdaac066aa0 con 0x7fdaac06b3b0 2023-10-14T11:23:31.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.105+0000 7fdaa8ff9700 1 -- 172.21.15.67:0/3060199102 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda94057030 con 0x7fdaac06b3b0 2023-10-14T11:23:31.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.107+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 msgr2=0x7fda8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 0x7fda8c06d3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007b10 tx=0x7fda9c007a60 comp rx=0 tx=0).stop 2023-10-14T11:23:31.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 msgr2=0x7fdaac0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fda9400c500 tx=0x7fda9400c810 comp rx=0 tx=0).stop 2023-10-14T11:23:31.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 shutdown_connections 2023-10-14T11:23:31.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdaac0b1960 0x7fdaac0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fda8c06af00 0x7fda8c06d3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdaac06b3b0 0x7fdaac0c9de0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 --2- 172.21.15.67:0/3060199102 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdaac0b0bb0 0x7fdaac14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 >> 172.21.15.67:0/3060199102 conn(0x7fdaac0d04b0 msgr2=0x7fdaac06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:31.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 shutdown_connections 2023-10-14T11:23:31.112 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.108+0000 7fdab25a2700 1 -- 172.21.15.67:0/3060199102 wait complete. 2023-10-14T11:23:31.122 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T11:23:31.122 DEBUG:teuthology.orchestra.run.smithi067:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:23:31.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T11:23:31.219 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T11:23:31.220 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:31.220 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:31.238 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:31.239 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:31.296 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:31.297 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:31.354 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:31.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.517+0000 7f896d963700 1 Processor -- start 2023-10-14T11:23:31.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.517+0000 7f896d963700 1 -- start start 2023-10-14T11:23:31.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f896d963700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 0x7f89680c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f896d963700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f896806af90 0x7f8968071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f896d963700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896815de40 con 0x7f89680c5a10 2023-10-14T11:23:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f896d963700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896806b3f0 con 0x7f896806af90 2023-10-14T11:23:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f896d963700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680c5e90 con 0x7f896815da60 2023-10-14T11:23:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f89677fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f896806af90 0x7f8968071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f89667fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f89680c5a10 0x7f896806a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41626/0 (socket says 172.21.15.67:41626) 2023-10-14T11:23:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f89667fc700 1 -- 172.21.15.67:0/3105227825 learned_addr learned my addr 172.21.15.67:0/3105227825 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.518+0000 7f89677fe700 1 --2- 172.21.15.67:0/3105227825 >> v2:172.21.15.67:3300/0 conn(0x7f896806af90 0x7f8968071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42334/0 (socket says 172.21.15.67:42334) 2023-10-14T11:23:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8966ffd700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 0x7f89680c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f89677fe700 1 -- 172.21.15.67:0/3105227825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 msgr2=0x7f89680c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f89677fe700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 0x7f89680c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f89677fe700 1 -- 172.21.15.67:0/3105227825 >> v1:172.21.15.67:6789/0 conn(0x7f89680c5a10 legacy=0x7f896806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8965ffb700 1 -- 172.21.15.67:0/3105227825 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924133856 0 0) 0x7f896815de40 con 0x7f89680c5a10 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f89677fe700 1 -- 172.21.15.67:0/3105227825 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89681616f0 con 0x7f896806af90 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8966ffd700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 0x7f89680c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f89677fe700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f8968071be0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8960009d90 tx=0x7f896000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94051ae166995c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8965ffb700 1 -- 172.21.15.67:0/3105227825 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000e070 con 0x7f896806af90 2023-10-14T11:23:31.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8965ffb700 1 -- 172.21.15.67:0/3105227825 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896000bbd0 con 0x7f896806af90 2023-10-14T11:23:31.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.519+0000 7f8965ffb700 1 -- 172.21.15.67:0/3105227825 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960012430 con 0x7f896806af90 2023-10-14T11:23:31.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 -- 172.21.15.67:0/3105227825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 msgr2=0x7f8968071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f8968071be0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8960009d90 tx=0x7f896000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:31.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 -- 172.21.15.67:0/3105227825 shutdown_connections 2023-10-14T11:23:31.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f8968071be0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 --2- 172.21.15.67:0/3105227825 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f896815da60 0x7f89680c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 -- 172.21.15.67:0/3105227825 >> 172.21.15.67:0/3105227825 conn(0x7f89680d0440 msgr2=0x7f89680d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:31.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 -- 172.21.15.67:0/3105227825 shutdown_connections 2023-10-14T11:23:31.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.520+0000 7f896d963700 1 -- 172.21.15.67:0/3105227825 wait complete. 2023-10-14T11:23:31.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.521+0000 7f896d963700 1 Processor -- start 2023-10-14T11:23:31.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.521+0000 7f896d963700 1 -- start start 2023-10-14T11:23:31.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 0x7f89680cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 0x7f896815e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680cf1f0 con 0x7f896806af90 2023-10-14T11:23:31.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896815b680 con 0x7f896815da60 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f896d963700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89680b3ce0 con 0x7f89680c5a10 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42336/0 (socket says 172.21.15.67:42336) 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 -- 172.21.15.67:0/1855484770 learned_addr learned my addr 172.21.15.67:0/1855484770 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f89667fc700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 0x7f89680cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f89677fe700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 0x7f896815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 -- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 msgr2=0x7f89680cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 0x7f89680cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 -- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 msgr2=0x7f896815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 0x7f896815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f8966ffd700 1 -- 172.21.15.67:0/1855484770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960009a70 con 0x7f896806af90 2023-10-14T11:23:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f89667fc700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 0x7f89680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.522+0000 7f89677fe700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 0x7f896815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f8966ffd700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f895800c750 tx=0x7f895800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958011800 con 0x7f896806af90 2023-10-14T11:23:31.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8958011960 con 0x7f896806af90 2023-10-14T11:23:31.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958011cd0 con 0x7f896806af90 2023-10-14T11:23:31.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89680b3720 con 0x7f896806af90 2023-10-14T11:23:31.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.523+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896815b310 con 0x7f896806af90 2023-10-14T11:23:31.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.524+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896815b170 con 0x7f896806af90 2023-10-14T11:23:31.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.524+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8958021350 con 0x7f896806af90 2023-10-14T11:23:31.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.525+0000 7f894ffff700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 0x7f895406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.525+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8958089630 con 0x7f896806af90 2023-10-14T11:23:31.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.525+0000 7f89667fc700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 0x7f895406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.525+0000 7f89667fc700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 0x7f895406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89680cc7d0 tx=0x7f895c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.529+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f896815b170 con 0x7f896806af90 2023-10-14T11:23:31.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.728+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f896815b170 con 0x7f896806af90 2023-10-14T11:23:31.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.729+0000 7f894ffff700 1 -- 172.21.15.67:0/1855484770 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f896815b170 con 0x7f896806af90 2023-10-14T11:23:31.731 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:31.731 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:31.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 msgr2=0x7f895406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 0x7f895406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f89680cc7d0 tx=0x7f895c009040 comp rx=0 tx=0).stop 2023-10-14T11:23:31.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 msgr2=0x7f89680b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f895800c750 tx=0x7f895800cb10 comp rx=0 tx=0).stop 2023-10-14T11:23:31.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 shutdown_connections 2023-10-14T11:23:31.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f896815da60 0x7f896815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f895406af00 0x7f895406d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f896806af90 0x7f89680b3020 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 --2- 172.21.15.67:0/1855484770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f89680c5a10 0x7f89680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 >> 172.21.15.67:0/1855484770 conn(0x7f89680d0440 msgr2=0x7f89680b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:31.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 shutdown_connections 2023-10-14T11:23:31.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.731+0000 7f896d963700 1 -- 172.21.15.67:0/1855484770 wait complete. 2023-10-14T11:23:31.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:31.747 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.873+0000 7fe7cb09b700 1 Processor -- start 2023-10-14T11:23:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.873+0000 7fe7cb09b700 1 -- start start 2023-10-14T11:23:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7c415aa60 0x7fe7c40ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe7c415ae40 0x7fe7c40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c40ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40d1300 con 0x7fe7c415ae40 2023-10-14T11:23:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd3b0 con 0x7fe7c415aa60 2023-10-14T11:23:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7cb09b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40ad3c0 con 0x7fe7c40ccf00 2023-10-14T11:23:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe7c415ae40 0x7fe7c40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe7c415ae40 0x7fe7c40cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42346/0 (socket says 172.21.15.67:42346) 2023-10-14T11:23:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 -- 172.21.15.67:0/3730693566 learned_addr learned my addr 172.21.15.67:0/3730693566 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c8e37700 1 --2- 172.21.15.67:0/3730693566 >> v2:172.21.15.72:3300/0 conn(0x7fe7c415aa60 0x7fe7c40ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c9638700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c40ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 -- 172.21.15.67:0/3730693566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 msgr2=0x7fe7c40ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c40ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 -- 172.21.15.67:0/3730693566 >> v2:172.21.15.72:3300/0 conn(0x7fe7c415aa60 msgr2=0x7fe7c40ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 --2- 172.21.15.67:0/3730693566 >> v2:172.21.15.72:3300/0 conn(0x7fe7c415aa60 0x7fe7c40ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c3fff700 1 -- 172.21.15.67:0/3730693566 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40ce8f0 con 0x7fe7c415ae40 2023-10-14T11:23:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.874+0000 7fe7c9638700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c40ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7c3fff700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40cc9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4074470 tx=0x7fe7b000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca04de82e359242 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7c37fe700 1 -- 172.21.15.67:0/3730693566 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b000dd30 con 0x7fe7c415ae40 2023-10-14T11:23:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7c37fe700 1 -- 172.21.15.67:0/3730693566 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b000de90 con 0x7fe7c415ae40 2023-10-14T11:23:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7c37fe700 1 -- 172.21.15.67:0/3730693566 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b0010690 con 0x7fe7c415ae40 2023-10-14T11:23:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 -- 172.21.15.67:0/3730693566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 msgr2=0x7fe7c40cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40cc9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4074470 tx=0x7fe7b000be70 comp rx=0 tx=0).stop 2023-10-14T11:23:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 -- 172.21.15.67:0/3730693566 shutdown_connections 2023-10-14T11:23:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c40ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/3730693566 >> v2:172.21.15.72:3300/0 conn(0x7fe7c415aa60 0x7fe7c40ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/3730693566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40cc9c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 -- 172.21.15.67:0/3730693566 >> 172.21.15.67:0/3730693566 conn(0x7fe7c40d04b0 msgr2=0x7fe7c40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 -- 172.21.15.67:0/3730693566 shutdown_connections 2023-10-14T11:23:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.875+0000 7fe7cb09b700 1 -- 172.21.15.67:0/3730693566 wait complete. 2023-10-14T11:23:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.877+0000 7fe7cb09b700 1 Processor -- start 2023-10-14T11:23:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.877+0000 7fe7cb09b700 1 -- start start 2023-10-14T11:23:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7c415aa60 0x7fe7c414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40c8870 con 0x7fe7c415ae40 2023-10-14T11:23:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c415b780 con 0x7fe7c415aa60 2023-10-14T11:23:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7cb09b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c414e210 con 0x7fe7c40ccf00 2023-10-14T11:23:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7c9638700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7c9638700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42352/0 (socket says 172.21.15.67:42352) 2023-10-14T11:23:31.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7c9638700 1 -- 172.21.15.67:0/4135937919 learned_addr learned my addr 172.21.15.67:0/4135937919 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:31.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7c8e37700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.878+0000 7fe7c3fff700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7c415aa60 0x7fe7c414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 -- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 msgr2=0x7fe7c415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 -- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7c415aa60 msgr2=0x7fe7c414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:31.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7c415aa60 0x7fe7c414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:31.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 -- 172.21.15.67:0/4135937919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b000b7f0 con 0x7fe7c415ae40 2023-10-14T11:23:31.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c9638700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00cf20 tx=0x7fe7bc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00aca0 con 0x7fe7c415ae40 2023-10-14T11:23:31.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc00ae00 con 0x7fe7c415ae40 2023-10-14T11:23:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40b0f10 con 0x7fe7c415ae40 2023-10-14T11:23:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc015680 con 0x7fe7c415ae40 2023-10-14T11:23:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.879+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c40b14d0 con 0x7fe7c415ae40 2023-10-14T11:23:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.880+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c40b16c0 con 0x7fe7c415ae40 2023-10-14T11:23:31.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.880+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7bc00d430 con 0x7fe7c415ae40 2023-10-14T11:23:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.881+0000 7fe7c17fa700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 0x7fe7a806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.881+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7bc089a30 con 0x7fe7c415ae40 2023-10-14T11:23:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.881+0000 7fe7c8e37700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 0x7fe7a806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:31.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.882+0000 7fe7c8e37700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 0x7fe7a806d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40c9ff0 tx=0x7fe7b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:31.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:31.885+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7bc054ae0 con 0x7fe7c415ae40 2023-10-14T11:23:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.084+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe7c404ebb0 con 0x7fe7c415ae40 2023-10-14T11:23:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.085+0000 7fe7c17fa700 1 -- 172.21.15.67:0/4135937919 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7bc058100 con 0x7fe7c415ae40 2023-10-14T11:23:32.087 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 msgr2=0x7fe7a806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 0x7fe7a806d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40c9ff0 tx=0x7fe7b8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 msgr2=0x7fe7c40afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00cf20 tx=0x7fe7bc00cf50 comp rx=0 tx=0).stop 2023-10-14T11:23:32.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 shutdown_connections 2023-10-14T11:23:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe7a806af00 0x7fe7a806d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe7c415ae40 0x7fe7c40afff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe7c40ccf00 0x7fe7c415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 --2- 172.21.15.67:0/4135937919 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7c415aa60 0x7fe7c414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 >> 172.21.15.67:0/4135937919 conn(0x7fe7c40d04b0 msgr2=0x7fe7c40cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 shutdown_connections 2023-10-14T11:23:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.087+0000 7fe7cb09b700 1 -- 172.21.15.67:0/4135937919 wait complete. 2023-10-14T11:23:32.101 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.227+0000 7fc8fd6a1700 1 Processor -- start 2023-10-14T11:23:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.227+0000 7fc8fd6a1700 1 -- start start 2023-10-14T11:23:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8fd6a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f80d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8fd6a1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8f80b6f70 0x7fc8f80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8fd6a1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f815bbb0 con 0x7fc8f80cc0e0 2023-10-14T11:23:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8fd6a1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8f80d0460 con 0x7fc8f80b6f70 2023-10-14T11:23:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8fd6a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80cc520 con 0x7fc8f815b7d0 2023-10-14T11:23:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8f67fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8f80b6f70 0x7fc8f80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8f6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f80d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8f77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8f80cc0e0 0x7fc8f80d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48478/0 (socket says 172.21.15.67:48478) 2023-10-14T11:23:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8f67fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8f80b6f70 0x7fc8f80cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42766/0 (socket says 172.21.15.67:42766) 2023-10-14T11:23:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.228+0000 7fc8f77fe700 1 -- 172.21.15.67:0/1238841084 learned_addr learned my addr 172.21.15.67:0/1238841084 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f67fc700 1 -- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 msgr2=0x7fc8f80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f67fc700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f80d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f67fc700 1 -- 172.21.15.67:0/1238841084 >> v1:172.21.15.72:6789/0 conn(0x7fc8f80cc0e0 legacy=0x7fc8f80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f67fc700 1 -- 172.21.15.67:0/1238841084 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f80cf6a0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f6ffd700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f5ffb700 1 -- 172.21.15.67:0/1238841084 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494207403 0 0) 0x7fc8f0001490 con 0x7fc8f80cc0e0 2023-10-14T11:23:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f67fc700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80cbba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009840 tx=0x7fc8e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a48eb824197e5c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f5ffb700 1 -- 172.21.15.67:0/1238841084 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0011830 con 0x7fc8f80b6f70 2023-10-14T11:23:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f5ffb700 1 -- 172.21.15.67:0/1238841084 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0011990 con 0x7fc8f80b6f70 2023-10-14T11:23:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.229+0000 7fc8f5ffb700 1 -- 172.21.15.67:0/1238841084 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0011d20 con 0x7fc8f80b6f70 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80b6f70 msgr2=0x7fc8f80cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80cbba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009840 tx=0x7fc8e0009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/1238841084 shutdown_connections 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/1238841084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80cbba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/1238841084 >> 172.21.15.67:0/1238841084 conn(0x7fc8f80665a0 msgr2=0x7fc8f8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/1238841084 shutdown_connections 2023-10-14T11:23:32.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.230+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/1238841084 wait complete. 2023-10-14T11:23:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.231+0000 7fc8fd6a1700 1 Processor -- start 2023-10-14T11:23:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.231+0000 7fc8fd6a1700 1 -- start start 2023-10-14T11:23:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80cc0e0 0x7fc8f8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f8157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80ca120 con 0x7fc8f80b6f70 2023-10-14T11:23:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f81588b0 con 0x7fc8f80cc0e0 2023-10-14T11:23:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8fd6a1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f80c97f0 con 0x7fc8f815b7d0 2023-10-14T11:23:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42366/0 (socket says 172.21.15.67:42366) 2023-10-14T11:23:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 -- 172.21.15.67:0/3128101464 learned_addr learned my addr 172.21.15.67:0/3128101464 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f67fc700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80cc0e0 0x7fc8f8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f77fe700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f8157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 -- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 msgr2=0x7fc8f8157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f8157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 -- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80cc0e0 msgr2=0x7fc8f8156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80cc0e0 0x7fc8f8156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 -- 172.21.15.67:0/3128101464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80094a0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f77fe700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.232+0000 7fc8f6ffd700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebe0 tx=0x7fc8e800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.233+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8009800 con 0x7fc8f80b6f70 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.233+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800c910 con 0x7fc8f80b6f70 2023-10-14T11:23:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.233+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e00094a0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.233+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800cc80 con 0x7fc8f80b6f70 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.233+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f80c9db0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.234+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f804ebb0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.234+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc8e8013470 con 0x7fc8f80b6f70 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.234+0000 7fc8ef7fe700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 0x7fc8d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.235+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8e8089790 con 0x7fc8f80b6f70 2023-10-14T11:23:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.235+0000 7fc8f67fc700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 0x7fc8d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.235+0000 7fc8f67fc700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 0x7fc8d806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00090b0 tx=0x7fc8e001c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.239+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8e80547c0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.437+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8f80d2320 con 0x7fc8f80b6f70 2023-10-14T11:23:32.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.438+0000 7fc8ef7fe700 1 -- 172.21.15.67:0/3128101464 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8e8057de0 con 0x7fc8f80b6f70 2023-10-14T11:23:32.440 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:32.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 msgr2=0x7fc8d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 0x7fc8d806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00090b0 tx=0x7fc8e001c040 comp rx=0 tx=0).stop 2023-10-14T11:23:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 msgr2=0x7fc8f80ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800ebe0 tx=0x7fc8e800eef0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 shutdown_connections 2023-10-14T11:23:32.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc8f815b7d0 0x7fc8f8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc8d806af00 0x7fc8d806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc8f80b6f70 0x7fc8f80ca5b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 --2- 172.21.15.67:0/3128101464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8f80cc0e0 0x7fc8f8156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 >> 172.21.15.67:0/3128101464 conn(0x7fc8f80665a0 msgr2=0x7fc8f80b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 shutdown_connections 2023-10-14T11:23:32.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.440+0000 7fc8fd6a1700 1 -- 172.21.15.67:0/3128101464 wait complete. 2023-10-14T11:23:32.454 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:32.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.581+0000 7fb42c98e700 1 Processor -- start 2023-10-14T11:23:32.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.581+0000 7fb42c98e700 1 -- start start 2023-10-14T11:23:32.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42c98e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 0x7fb4280cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42c98e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4280b1250 0x7fb4280b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42c98e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280b0f90 con 0x7fb4280b0bb0 2023-10-14T11:23:32.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42c98e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280cde00 con 0x7fb4280b1250 2023-10-14T11:23:32.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42c98e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4280b1bc0 con 0x7fb42806b3b0 2023-10-14T11:23:32.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4280b1250 0x7fb4280b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fb4280b1250 0x7fb4280b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42376/0 (socket says 172.21.15.67:42376) 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42659c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb4280b0bb0 0x7fb4280cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41666/0 (socket says 172.21.15.67:41666) 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 -- 172.21.15.67:0/1598914318 learned_addr learned my addr 172.21.15.67:0/1598914318 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb425d9b700 1 --2- 172.21.15.67:0/1598914318 >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 0x7fb4280cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 -- 172.21.15.67:0/1598914318 >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 msgr2=0x7fb4280cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 --2- 172.21.15.67:0/1598914318 >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 0x7fb4280cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 -- 172.21.15.67:0/1598914318 >> v1:172.21.15.67:6789/0 conn(0x7fb4280b0bb0 legacy=0x7fb4280cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 -- 172.21.15.67:0/1598914318 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280cc820 con 0x7fb4280b1250 2023-10-14T11:23:32.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb425d9b700 1 --2- 172.21.15.67:0/1598914318 >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 0x7fb4280cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:32.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb426d9d700 1 --2- 172.21.15.67:0/1598914318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b1250 0x7fb4280b1680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4280cdfa0 tx=0x7fb42000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1adf688c173cffd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42559a700 1 -- 172.21.15.67:0/1598914318 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000e070 con 0x7fb4280b1250 2023-10-14T11:23:32.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42559a700 1 -- 172.21.15.67:0/1598914318 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42000b9c0 con 0x7fb4280b1250 2023-10-14T11:23:32.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.582+0000 7fb42559a700 1 -- 172.21.15.67:0/1598914318 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000bd70 con 0x7fb4280b1250 2023-10-14T11:23:32.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 -- 172.21.15.67:0/1598914318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b1250 msgr2=0x7fb4280b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 --2- 172.21.15.67:0/1598914318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b1250 0x7fb4280b1680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb4280cdfa0 tx=0x7fb42000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:32.589 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 -- 172.21.15.67:0/1598914318 shutdown_connections 2023-10-14T11:23:32.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 --2- 172.21.15.67:0/1598914318 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b1250 0x7fb4280b1680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 --2- 172.21.15.67:0/1598914318 >> v2:172.21.15.72:3300/0 conn(0x7fb42806b3b0 0x7fb4280cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 -- 172.21.15.67:0/1598914318 >> 172.21.15.67:0/1598914318 conn(0x7fb4280d04b0 msgr2=0x7fb4280d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 -- 172.21.15.67:0/1598914318 shutdown_connections 2023-10-14T11:23:32.590 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.583+0000 7fb42c98e700 1 -- 172.21.15.67:0/1598914318 wait complete. 2023-10-14T11:23:32.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.584+0000 7fb42c98e700 1 Processor -- start 2023-10-14T11:23:32.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.584+0000 7fb42c98e700 1 -- start start 2023-10-14T11:23:32.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42806b3b0 0x7fb4280b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.593 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4280b1250 0x7fb4280afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb428158530 con 0x7fb4280b0bb0 2023-10-14T11:23:32.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281586c0 con 0x7fb42806b3b0 2023-10-14T11:23:32.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb42c98e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb428159240 con 0x7fb4280b1250 2023-10-14T11:23:32.594 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb425d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb425d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42380/0 (socket says 172.21.15.67:42380) 2023-10-14T11:23:32.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.585+0000 7fb425d9b700 1 -- 172.21.15.67:0/269304256 learned_addr learned my addr 172.21.15.67:0/269304256 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:32.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb42659c700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42806b3b0 0x7fb4280b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb426d9d700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4280b1250 0x7fb4280afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.595 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 -- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4280b1250 msgr2=0x7fb4280afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4280b1250 0x7fb4280afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 -- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42806b3b0 msgr2=0x7fb4280b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42806b3b0 0x7fb4280b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 -- 172.21.15.67:0/269304256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009b30 con 0x7fb4280b0bb0 2023-10-14T11:23:32.596 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb425d9b700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c780 tx=0x7fb41800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011800 con 0x7fb4280b0bb0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418011960 con 0x7fb4280b0bb0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb428158910 con 0x7fb4280b0bb0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418011cd0 con 0x7fb4280b0bb0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.586+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb428158ed0 con 0x7fb4280b0bb0 2023-10-14T11:23:32.597 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.587+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42804ebb0 con 0x7fb4280b0bb0 2023-10-14T11:23:32.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.587+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb418021350 con 0x7fb4280b0bb0 2023-10-14T11:23:32.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.588+0000 7fb416ffd700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 0x7fb40806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.588+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb418089510 con 0x7fb4280b0bb0 2023-10-14T11:23:32.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.588+0000 7fb42659c700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 0x7fb40806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.598 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.588+0000 7fb42659c700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 0x7fb40806d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000f60 tx=0x7fb41c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.599 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.592+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4180545d0 con 0x7fb4280b0bb0 2023-10-14T11:23:32.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.795+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb428159380 con 0x7fb4280b0bb0 2023-10-14T11:23:32.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.796+0000 7fb416ffd700 1 -- 172.21.15.67:0/269304256 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb418057bf0 con 0x7fb4280b0bb0 2023-10-14T11:23:32.798 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 msgr2=0x7fb40806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 0x7fb40806d3c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000f60 tx=0x7fb41c009040 comp rx=0 tx=0).stop 2023-10-14T11:23:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 msgr2=0x7fb4280af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c780 tx=0x7fb41800cb40 comp rx=0 tx=0).stop 2023-10-14T11:23:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 shutdown_connections 2023-10-14T11:23:32.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4280b1250 0x7fb4280afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb42806b3b0 0x7fb4280b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40806af00 0x7fb40806d3c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 --2- 172.21.15.67:0/269304256 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb4280b0bb0 0x7fb4280af6a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 >> 172.21.15.67:0/269304256 conn(0x7fb4280d04b0 msgr2=0x7fb4280cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 shutdown_connections 2023-10-14T11:23:32.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.798+0000 7fb42c98e700 1 -- 172.21.15.67:0/269304256 wait complete. 2023-10-14T11:23:32.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:23:32.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.936+0000 7f1af3bee700 1 Processor -- start 2023-10-14T11:23:32.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.936+0000 7f1af3bee700 1 -- start start 2023-10-14T11:23:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af3bee700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1aec15e0c0 0x7f1aec072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af3bee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 0x7f1aec0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af3bee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec072ac0 con 0x7f1aec0c52c0 2023-10-14T11:23:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af3bee700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0cfa80 con 0x7f1aec15e0c0 2023-10-14T11:23:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af3bee700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0cfd60 con 0x7f1aec15e4a0 2023-10-14T11:23:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af198a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1aec15e0c0 0x7f1aec072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af198a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1aec15e0c0 0x7f1aec072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42386/0 (socket says 172.21.15.67:42386) 2023-10-14T11:23:32.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af198a700 1 -- 172.21.15.67:0/3166910375 learned_addr learned my addr 172.21.15.67:0/3166910375 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:32.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.937+0000 7f1af1189700 1 --2- 172.21.15.67:0/3166910375 >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 0x7f1aec0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af198a700 1 -- 172.21.15.67:0/3166910375 >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 msgr2=0x7f1aec0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:32.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af198a700 1 --2- 172.21.15.67:0/3166910375 >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 0x7f1aec0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af198a700 1 -- 172.21.15.67:0/3166910375 >> v1:172.21.15.72:6789/0 conn(0x7f1aec0c52c0 legacy=0x7f1aec06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af198a700 1 -- 172.21.15.67:0/3166910375 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0d0040 con 0x7f1aec15e0c0 2023-10-14T11:23:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af1189700 1 --2- 172.21.15.67:0/3166910375 >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 0x7f1aec0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:32.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af198a700 1 --2- 172.21.15.67:0/3166910375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec15e0c0 0x7f1aec072580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1aec071b70 tx=0x7f1adc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e6238266b2c0ae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af0988700 1 -- 172.21.15.67:0/3166910375 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc004230 con 0x7f1aec15e0c0 2023-10-14T11:23:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af0988700 1 -- 172.21.15.67:0/3166910375 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc004390 con 0x7f1aec15e0c0 2023-10-14T11:23:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af0988700 1 -- 172.21.15.67:0/3166910375 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc0036a0 con 0x7f1aec15e0c0 2023-10-14T11:23:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 -- 172.21.15.67:0/3166910375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec15e0c0 msgr2=0x7f1aec072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 --2- 172.21.15.67:0/3166910375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec15e0c0 0x7f1aec072580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1aec071b70 tx=0x7f1adc009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.947 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 -- 172.21.15.67:0/3166910375 shutdown_connections 2023-10-14T11:23:32.947 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 --2- 172.21.15.67:0/3166910375 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec15e0c0 0x7f1aec072580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.947 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 --2- 172.21.15.67:0/3166910375 >> v2:172.21.15.72:3300/0 conn(0x7f1aec15e4a0 0x7f1aec0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.947 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.938+0000 7f1af3bee700 1 -- 172.21.15.67:0/3166910375 >> 172.21.15.67:0/3166910375 conn(0x7f1aec0d0440 msgr2=0x7f1aec0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:32.947 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.939+0000 7f1af3bee700 1 -- 172.21.15.67:0/3166910375 shutdown_connections 2023-10-14T11:23:32.948 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.939+0000 7f1af3bee700 1 -- 172.21.15.67:0/3166910375 wait complete. 2023-10-14T11:23:32.950 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.940+0000 7f1af3bee700 1 Processor -- start 2023-10-14T11:23:32.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.940+0000 7f1af3bee700 1 -- start start 2023-10-14T11:23:32.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec15e0c0 0x7f1aec14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1aec15e4a0 0x7f1aec14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.951 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b3570 con 0x7f1aec0c52c0 2023-10-14T11:23:32.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec150360 con 0x7f1aec15e0c0 2023-10-14T11:23:32.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec150640 con 0x7f1aec15e4a0 2023-10-14T11:23:32.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.952 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42392/0 (socket says 172.21.15.67:42392) 2023-10-14T11:23:32.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 -- 172.21.15.67:0/1521739729 learned_addr learned my addr 172.21.15.67:0/1521739729 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:32.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af218b700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1aec15e4a0 0x7f1aec14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af1189700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec15e0c0 0x7f1aec14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 -- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1aec15e4a0 msgr2=0x7f1aec14a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1aec15e4a0 0x7f1aec14a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 -- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec15e0c0 msgr2=0x7f1aec14d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:32.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec15e0c0 0x7f1aec14d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:32.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 -- 172.21.15.67:0/1521739729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc009550 con 0x7f1aec0c52c0 2023-10-14T11:23:32.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af198a700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0cdfc0 tx=0x7f1adc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc003c90 con 0x7f1aec0c52c0 2023-10-14T11:23:32.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc01f070 con 0x7f1aec0c52c0 2023-10-14T11:23:32.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec150920 con 0x7f1aec0c52c0 2023-10-14T11:23:32.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011870 con 0x7f1aec0c52c0 2023-10-14T11:23:32.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.941+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec14a990 con 0x7f1aec0c52c0 2023-10-14T11:23:32.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.942+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec150b30 con 0x7f1aec0c52c0 2023-10-14T11:23:32.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.943+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1adc021030 con 0x7f1aec0c52c0 2023-10-14T11:23:32.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.943+0000 7f1ae27fc700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 0x7f1ad006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:32.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.943+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1adc08aac0 con 0x7f1aec0c52c0 2023-10-14T11:23:32.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.944+0000 7f1af1189700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 0x7f1ad006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:32.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.944+0000 7f1af1189700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 0x7f1ad006d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0c5af0 tx=0x7f1ae8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:32.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:32.948+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1adc055c00 con 0x7f1aec0c52c0 2023-10-14T11:23:33.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.165+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1aec04ebb0 con 0x7f1aec0c52c0 2023-10-14T11:23:33.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.165+0000 7f1ae27fc700 1 -- 172.21.15.67:0/1521739729 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1adc0119d0 con 0x7f1aec0c52c0 2023-10-14T11:23:33.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 msgr2=0x7f1ad006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 0x7f1ad006d3c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0c5af0 tx=0x7f1ae8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:33.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 msgr2=0x7f1aec0b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1aec0cdfc0 tx=0x7f1adc004750 comp rx=0 tx=0).stop 2023-10-14T11:23:33.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 shutdown_connections 2023-10-14T11:23:33.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1aec15e4a0 0x7f1aec14a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ad006af00 0x7f1ad006d3c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1aec0c52c0 0x7f1aec0b2f90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 --2- 172.21.15.67:0/1521739729 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1aec15e0c0 0x7f1aec14d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 >> 172.21.15.67:0/1521739729 conn(0x7f1aec0d0440 msgr2=0x7f1aec06f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:33.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 shutdown_connections 2023-10-14T11:23:33.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.167+0000 7f1af3bee700 1 -- 172.21.15.67:0/1521739729 wait complete. 2023-10-14T11:23:33.172 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2023-10-14T11:23:33.181 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-14T11:23:33.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:33.182 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-14T11:23:33.220 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:23:33.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:33.221 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T11:23:33.285 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:33.286 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:33.307 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:33.308 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:33.368 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:33.368 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:33.427 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:33.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.551+0000 7f75cf2de700 1 Processor -- start 2023-10-14T11:23:33.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.551+0000 7f75cf2de700 1 -- start start 2023-10-14T11:23:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cf2de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f75c80ceb30 0x7f75c80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cf2de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 0x7f75c80cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cf2de700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80cef10 con 0x7f75c80cffe0 2023-10-14T11:23:33.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cf2de700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c80d2090 con 0x7f75c80ceb30 2023-10-14T11:23:33.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cf2de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c815deb0 con 0x7f75c80cdc30 2023-10-14T11:23:33.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cd87b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f75c80cffe0 0x7f75c815f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41698/0 (socket says 172.21.15.67:41698) 2023-10-14T11:23:33.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cd87b700 1 -- 172.21.15.67:0/3883177609 learned_addr learned my addr 172.21.15.67:0/3883177609 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:33.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cc879700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 0x7f75c80cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75cd07a700 1 --2- 172.21.15.67:0/3883177609 >> v2:172.21.15.72:3300/0 conn(0x7f75c80ceb30 0x7f75c80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.552+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371962954 0 0) 0x7f75c80cef10 con 0x7f75c80cffe0 2023-10-14T11:23:33.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b40035b0 con 0x7f75c80cffe0 2023-10-14T11:23:33.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341528617 0 0) 0x7f75b40035b0 con 0x7f75c80cffe0 2023-10-14T11:23:33.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cd07a700 1 -- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 msgr2=0x7f75c80cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cd07a700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 0x7f75c80cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cd07a700 1 -- 172.21.15.67:0/3883177609 >> v1:172.21.15.67:6789/0 conn(0x7f75c80cffe0 legacy=0x7f75c815f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cd07a700 1 -- 172.21.15.67:0/3883177609 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80d22e0 con 0x7f75c80ceb30 2023-10-14T11:23:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cc879700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 0x7f75c80cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:33.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75cd07a700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80ceb30 0x7f75c80b04c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009840 tx=0x7f75b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ad7a5addc2abb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00019f0 con 0x7f75c80ceb30 2023-10-14T11:23:33.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b8004030 con 0x7f75c80ceb30 2023-10-14T11:23:33.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.553+0000 7f75bffff700 1 -- 172.21.15.67:0/3883177609 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80043a0 con 0x7f75c80ceb30 2023-10-14T11:23:33.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 -- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80ceb30 msgr2=0x7f75c80b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80ceb30 0x7f75c80b04c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009840 tx=0x7f75b8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:33.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 -- 172.21.15.67:0/3883177609 shutdown_connections 2023-10-14T11:23:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80ceb30 0x7f75c80b04c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 --2- 172.21.15.67:0/3883177609 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80cdc30 0x7f75c80cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 -- 172.21.15.67:0/3883177609 >> 172.21.15.67:0/3883177609 conn(0x7f75c80d1570 msgr2=0x7f75c80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 -- 172.21.15.67:0/3883177609 shutdown_connections 2023-10-14T11:23:33.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.554+0000 7f75cf2de700 1 -- 172.21.15.67:0/3883177609 wait complete. 2023-10-14T11:23:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.555+0000 7f75cf2de700 1 Processor -- start 2023-10-14T11:23:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.555+0000 7f75cf2de700 1 -- start start 2023-10-14T11:23:33.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 0x7f75c814acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 0x7f75c815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c814b590 con 0x7f75c80cffe0 2023-10-14T11:23:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c814b870 con 0x7f75c80cdc30 2023-10-14T11:23:33.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cf2de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c814bb50 con 0x7f75c80ceb30 2023-10-14T11:23:33.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42410/0 (socket says 172.21.15.67:42410) 2023-10-14T11:23:33.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 -- 172.21.15.67:0/117905296 learned_addr learned my addr 172.21.15.67:0/117905296 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:33.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cc879700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 0x7f75c815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd07a700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 0x7f75c814acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 -- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 msgr2=0x7f75c815b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 0x7f75c815b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 -- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 msgr2=0x7f75c814acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 0x7f75c814acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 -- 172.21.15.67:0/117905296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40094a0 con 0x7f75c80cffe0 2023-10-14T11:23:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cc879700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 0x7f75c815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd07a700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 0x7f75c814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.556+0000 7f75cd87b700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f75c000cbe0 tx=0x7f75c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.557+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c000ab80 con 0x7f75c80cffe0 2023-10-14T11:23:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.557+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c000ad00 con 0x7f75c80cffe0 2023-10-14T11:23:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.557+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b80094a0 con 0x7f75c80cffe0 2023-10-14T11:23:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.557+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007310 con 0x7f75c80cffe0 2023-10-14T11:23:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.557+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c814c350 con 0x7f75c80cffe0 2023-10-14T11:23:33.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.558+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c814c070 con 0x7f75c80cffe0 2023-10-14T11:23:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.558+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75c0007470 con 0x7f75c80cffe0 2023-10-14T11:23:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.558+0000 7f75bdffb700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 0x7f75ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.559+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75c00894b0 con 0x7f75c80cffe0 2023-10-14T11:23:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.559+0000 7f75cd07a700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 0x7f75ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.571 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.559+0000 7f75cd07a700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 0x7f75ac06d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75b80090b0 tx=0x7f75b8013040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.563+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f75c814c070 con 0x7f75c80cffe0 2023-10-14T11:23:33.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.766+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75c814c070 con 0x7f75c80cffe0 2023-10-14T11:23:33.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.767+0000 7f75bdffb700 1 -- 172.21.15.67:0/117905296 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f75c814c070 con 0x7f75c80cffe0 2023-10-14T11:23:33.770 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:33.771 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:33.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 msgr2=0x7f75ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 0x7f75ac06d3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75b80090b0 tx=0x7f75b8013040 comp rx=0 tx=0).stop 2023-10-14T11:23:33.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 msgr2=0x7f75c815b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f75c000cbe0 tx=0x7f75c000a060 comp rx=0 tx=0).stop 2023-10-14T11:23:33.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 shutdown_connections 2023-10-14T11:23:33.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75ac06af00 0x7f75ac06d3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75c80cffe0 0x7f75c815b7e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75c80cdc30 0x7f75c814acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 --2- 172.21.15.67:0/117905296 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f75c80ceb30 0x7f75c815b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 >> 172.21.15.67:0/117905296 conn(0x7f75c80d1570 msgr2=0x7f75c80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:33.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 shutdown_connections 2023-10-14T11:23:33.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.769+0000 7f75cf2de700 1 -- 172.21.15.67:0/117905296 wait complete. 2023-10-14T11:23:33.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:33.784 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:33.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:23:33.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:23:33.912 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.910+0000 7f829f6b1700 1 Processor -- start 2023-10-14T11:23:33.912 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.910+0000 7f829f6b1700 1 -- start start 2023-10-14T11:23:33.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f829815aa60 0x7f82980ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f829815ae40 0x7f82980cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f82980ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980d1300 con 0x7f829815ae40 2023-10-14T11:23:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980cd3b0 con 0x7f829815aa60 2023-10-14T11:23:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829f6b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980ad3c0 con 0x7f82980ccf00 2023-10-14T11:23:33.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829cc4c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f829815ae40 0x7f82980cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829cc4c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f829815ae40 0x7f82980cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42416/0 (socket says 172.21.15.67:42416) 2023-10-14T11:23:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829cc4c700 1 -- 172.21.15.67:0/2443882169 learned_addr learned my addr 172.21.15.67:0/2443882169 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.911+0000 7f829dc4e700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f82980ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829d44d700 1 --2- 172.21.15.67:0/2443882169 >> v2:172.21.15.72:3300/0 conn(0x7f829815aa60 0x7f82980ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 -- 172.21.15.67:0/2443882169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 msgr2=0x7f82980ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:33.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f82980ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 -- 172.21.15.67:0/2443882169 >> v2:172.21.15.72:3300/0 conn(0x7f829815aa60 msgr2=0x7f82980ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 --2- 172.21.15.67:0/2443882169 >> v2:172.21.15.72:3300/0 conn(0x7f829815aa60 0x7f82980ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 -- 172.21.15.67:0/2443882169 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980ce8f0 con 0x7f829815ae40 2023-10-14T11:23:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f829cc4c700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cc9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8298074470 tx=0x7f8288009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5f059413566f6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f828ffff700 1 -- 172.21.15.67:0/2443882169 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011830 con 0x7f829815ae40 2023-10-14T11:23:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f828ffff700 1 -- 172.21.15.67:0/2443882169 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288011990 con 0x7f829815ae40 2023-10-14T11:23:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.912+0000 7f828ffff700 1 -- 172.21.15.67:0/2443882169 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288011d20 con 0x7f829815ae40 2023-10-14T11:23:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 -- 172.21.15.67:0/2443882169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 msgr2=0x7f82980cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cc9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8298074470 tx=0x7f8288009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 -- 172.21.15.67:0/2443882169 shutdown_connections 2023-10-14T11:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f82980ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 --2- 172.21.15.67:0/2443882169 >> v2:172.21.15.72:3300/0 conn(0x7f829815aa60 0x7f82980ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 --2- 172.21.15.67:0/2443882169 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cc9c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 -- 172.21.15.67:0/2443882169 >> 172.21.15.67:0/2443882169 conn(0x7f82980d04b0 msgr2=0x7f82980d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:33.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 -- 172.21.15.67:0/2443882169 shutdown_connections 2023-10-14T11:23:33.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.913+0000 7f829f6b1700 1 -- 172.21.15.67:0/2443882169 wait complete. 2023-10-14T11:23:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.914+0000 7f829f6b1700 1 Processor -- start 2023-10-14T11:23:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.914+0000 7f829f6b1700 1 -- start start 2023-10-14T11:23:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f8298150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f829815aa60 0x7f82981568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298151f40 con 0x7f829815ae40 2023-10-14T11:23:33.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980c7a90 con 0x7f829815aa60 2023-10-14T11:23:33.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829f6b1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8298151980 con 0x7f82980ccf00 2023-10-14T11:23:33.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42424/0 (socket says 172.21.15.67:42424) 2023-10-14T11:23:33.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 -- 172.21.15.67:0/1605204301 learned_addr learned my addr 172.21.15.67:0/1605204301 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:33.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829d44d700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f8298150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829cc4c700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f829815aa60 0x7f82981568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 -- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 msgr2=0x7f8298150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f8298150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 -- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f829815aa60 msgr2=0x7f82981568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f829815aa60 0x7f82981568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.915+0000 7f829dc4e700 1 -- 172.21.15.67:0/1605204301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009550 con 0x7f829815ae40 2023-10-14T11:23:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f829dc4e700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f829000ef00 tx=0x7f829000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290010040 con 0x7f829815ae40 2023-10-14T11:23:33.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000bc80 con 0x7f829815ae40 2023-10-14T11:23:33.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290009e40 con 0x7f829815ae40 2023-10-14T11:23:33.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8298151c60 con 0x7f829815ae40 2023-10-14T11:23:33.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.916+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82981515a0 con 0x7f829815ae40 2023-10-14T11:23:33.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.917+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980c7580 con 0x7f829815ae40 2023-10-14T11:23:33.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.918+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8290014400 con 0x7f829815ae40 2023-10-14T11:23:33.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.918+0000 7f828dffb700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 0x7f827c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:33.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.918+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8290089870 con 0x7f829815ae40 2023-10-14T11:23:33.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.918+0000 7f829d44d700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 0x7f827c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:33.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.919+0000 7f829d44d700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 0x7f827c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8294009be0 tx=0x7f8294009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:33.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:33.923+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82980c7580 con 0x7f829815ae40 2023-10-14T11:23:34.128 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.126+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82980c7580 con 0x7f829815ae40 2023-10-14T11:23:34.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.126+0000 7f828dffb700 1 -- 172.21.15.67:0/1605204301 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82980c7580 con 0x7f829815ae40 2023-10-14T11:23:34.129 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 msgr2=0x7f827c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 0x7f827c06d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8294009be0 tx=0x7f8294009210 comp rx=0 tx=0).stop 2023-10-14T11:23:34.131 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 msgr2=0x7f82980cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f829000ef00 tx=0x7f829000b390 comp rx=0 tx=0).stop 2023-10-14T11:23:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 shutdown_connections 2023-10-14T11:23:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f827c06af00 0x7f827c06d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f829815ae40 0x7f82980cb3f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f82980ccf00 0x7f8298150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 --2- 172.21.15.67:0/1605204301 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f829815aa60 0x7f82981568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 >> 172.21.15.67:0/1605204301 conn(0x7f82980d04b0 msgr2=0x7f82980d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 shutdown_connections 2023-10-14T11:23:34.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.129+0000 7f829f6b1700 1 -- 172.21.15.67:0/1605204301 wait complete. 2023-10-14T11:23:34.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:34.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.270+0000 7f70bca66700 1 Processor -- start 2023-10-14T11:23:34.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.270+0000 7f70bca66700 1 -- start start 2023-10-14T11:23:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70bca66700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70b8161e00 0x7f70b8154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70bca66700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80cd7d0 con 0x7f70b80cf830 2023-10-14T11:23:34.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70bca66700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80ce350 con 0x7f70b815e7e0 2023-10-14T11:23:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70bca66700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80ccbb0 con 0x7f70b8161e00 2023-10-14T11:23:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70b5d9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f70b80cf830 0x7f70b81616f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41724/0 (socket says 172.21.15.67:41724) 2023-10-14T11:23:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.271+0000 7f70b5d9b700 1 -- 172.21.15.67:0/2803237672 learned_addr learned my addr 172.21.15.67:0/2803237672 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:34.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/2803237672 >> v2:172.21.15.72:3300/0 conn(0x7f70b8161e00 0x7f70b8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946885255 0 0) 0x7f70b80cd7d0 con 0x7f70b80cf830 2023-10-14T11:23:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a40035b0 con 0x7f70b80cf830 2023-10-14T11:23:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3700579638 0 0) 0x7f70a40035b0 con 0x7f70b80cf830 2023-10-14T11:23:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 >> v2:172.21.15.72:3300/0 conn(0x7f70b8161e00 msgr2=0x7f70b8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:34.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 --2- 172.21.15.67:0/2803237672 >> v2:172.21.15.72:3300/0 conn(0x7f70b8161e00 0x7f70b8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 >> v1:172.21.15.72:6789/0 conn(0x7f70b815e7e0 legacy=0x7f70b80cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8162250 con 0x7f70b80cf830 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f70a0001670 con 0x7f70b80cf830 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 >> v1:172.21.15.67:6789/0 conn(0x7f70b80cf830 legacy=0x7f70b81616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 0x7f70a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4004850 0x7f70a4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a4005210 0x7f70a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80ccbb0 con 0x7f70a4003a00 2023-10-14T11:23:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400c0b0 con 0x7f70a4005210 2023-10-14T11:23:34.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a400c270 con 0x7f70a4004850 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 0x7f70a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a4005210 0x7f70a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b5d9b700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4004850 0x7f70a4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 -- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4004850 msgr2=0x7f70a4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4004850 0x7f70a4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 -- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a4005210 msgr2=0x7f70a400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70a4005210 0x7f70a400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b6d9d700 1 -- 172.21.15.67:0/2803237672 reap_dead start 2023-10-14T11:23:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.272+0000 7f70b659c700 1 -- 172.21.15.67:0/2803237672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40035b0 con 0x7f70a4003a00 2023-10-14T11:23:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70b659c700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 0x7f70a4003e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f70a80017c0 tx=0x7f70a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ceaeb79726999b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80052d0 con 0x7f70a4003a00 2023-10-14T11:23:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8005450 con 0x7f70a4003a00 2023-10-14T11:23:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70b559a700 1 -- 172.21.15.67:0/2803237672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80038c0 con 0x7f70a4003a00 2023-10-14T11:23:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 -- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 msgr2=0x7f70a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 0x7f70a4003e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f70a80017c0 tx=0x7f70a4005880 comp rx=0 tx=0).stop 2023-10-14T11:23:34.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 -- 172.21.15.67:0/2803237672 shutdown_connections 2023-10-14T11:23:34.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 --2- 172.21.15.67:0/2803237672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70a4003a00 0x7f70a4003e20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 -- 172.21.15.67:0/2803237672 >> 172.21.15.67:0/2803237672 conn(0x7f70b80665a0 msgr2=0x7f70b8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 -- 172.21.15.67:0/2803237672 shutdown_connections 2023-10-14T11:23:34.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.273+0000 7f70bca66700 1 -- 172.21.15.67:0/2803237672 wait complete. 2023-10-14T11:23:34.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 Processor -- start 2023-10-14T11:23:34.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 -- start start 2023-10-14T11:23:34.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4003a00 0x7f70b81f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b80c7600 0x7f70b80c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c82d0 con 0x7f70b80c8b60 2023-10-14T11:23:34.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c5a60 con 0x7f70b80c7600 2023-10-14T11:23:34.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.275+0000 7f70bca66700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80c5ce0 con 0x7f70a4003a00 2023-10-14T11:23:34.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42442/0 (socket says 172.21.15.67:42442) 2023-10-14T11:23:34.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 -- 172.21.15.67:0/14463399 learned_addr learned my addr 172.21.15.67:0/14463399 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:34.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b659c700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4003a00 0x7f70b81f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b5d9b700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b80c7600 0x7f70b80c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 -- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4003a00 msgr2=0x7f70b81f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4003a00 0x7f70b81f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 -- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b80c7600 msgr2=0x7f70b80c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b80c7600 0x7f70b80c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 -- 172.21.15.67:0/14463399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80c5fc0 con 0x7f70b80c8b60 2023-10-14T11:23:34.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70b806fc60 tx=0x7f70b0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000e040 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b000f040 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80c62a0 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000fc40 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.276+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b80c6860 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.277+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b81f2ec0 con 0x7f70b80c8b60 2023-10-14T11:23:34.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.278+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70b0022460 con 0x7f70b80c8b60 2023-10-14T11:23:34.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.278+0000 7f70aeffd700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 0x7f709806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.279+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70b008a650 con 0x7f70b80c8b60 2023-10-14T11:23:34.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.279+0000 7f70b659c700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 0x7f709806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.279+0000 7f70b659c700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 0x7f709806d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005040 tx=0x7f70a8009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.282+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70b00556e0 con 0x7f70b80c8b60 2023-10-14T11:23:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.485+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70b81f2ec0 con 0x7f70b80c8b60 2023-10-14T11:23:34.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.485+0000 7f70aeffd700 1 -- 172.21.15.67:0/14463399 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70b81f2ec0 con 0x7f70b80c8b60 2023-10-14T11:23:34.488 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 msgr2=0x7f709806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 0x7f709806d3c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005040 tx=0x7f70a8009030 comp rx=0 tx=0).stop 2023-10-14T11:23:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 msgr2=0x7f70b80c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f70b806fc60 tx=0x7f70b0011e20 comp rx=0 tx=0).stop 2023-10-14T11:23:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 shutdown_connections 2023-10-14T11:23:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f709806af00 0x7f709806d3c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80c8b60 0x7f70b80c9010 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70a4003a00 0x7f70b81f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 --2- 172.21.15.67:0/14463399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b80c7600 0x7f70b80c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 >> 172.21.15.67:0/14463399 conn(0x7f70b80665a0 msgr2=0x7f70b80d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.487+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 shutdown_connections 2023-10-14T11:23:34.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.488+0000 7f70bca66700 1 -- 172.21.15.67:0/14463399 wait complete. 2023-10-14T11:23:34.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:34.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.627+0000 7f43e1da1700 1 Processor -- start 2023-10-14T11:23:34.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.627+0000 7f43e1da1700 1 -- start start 2023-10-14T11:23:34.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43e1da1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43dc06a810 0x7f43dc0666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43e1da1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43dc066be0 0x7f43dc15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43e1da1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc15f480 con 0x7f43dc06e770 2023-10-14T11:23:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43e1da1700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc06ac90 con 0x7f43dc06a810 2023-10-14T11:23:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43e1da1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0cc510 con 0x7f43dc066be0 2023-10-14T11:23:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43daffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43dc06a810 0x7f43dc0666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43daffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f43dc06a810 0x7f43dc0666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42448/0 (socket says 172.21.15.67:42448) 2023-10-14T11:23:34.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.628+0000 7f43daffd700 1 -- 172.21.15.67:0/532940664 learned_addr learned my addr 172.21.15.67:0/532940664 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43dbfff700 1 --2- 172.21.15.67:0/532940664 >> v2:172.21.15.72:3300/0 conn(0x7f43dc066be0 0x7f43dc15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43daffd700 1 -- 172.21.15.67:0/532940664 >> v2:172.21.15.72:3300/0 conn(0x7f43dc066be0 msgr2=0x7f43dc15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43daffd700 1 --2- 172.21.15.67:0/532940664 >> v2:172.21.15.72:3300/0 conn(0x7f43dc066be0 0x7f43dc15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43daffd700 1 -- 172.21.15.67:0/532940664 >> v1:172.21.15.72:6789/0 conn(0x7f43dc06e770 legacy=0x7f43dc06eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.634 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43daffd700 1 -- 172.21.15.67:0/532940664 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc15f6d0 con 0x7f43dc06a810 2023-10-14T11:23:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43daffd700 1 --2- 172.21.15.67:0/532940664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06a810 0x7f43dc0666a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0a1030 tx=0x7f43c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e104fa631794c291 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43da7fc700 1 -- 172.21.15.67:0/532940664 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4011830 con 0x7f43dc06a810 2023-10-14T11:23:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43da7fc700 1 -- 172.21.15.67:0/532940664 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4011990 con 0x7f43dc06a810 2023-10-14T11:23:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.629+0000 7f43da7fc700 1 -- 172.21.15.67:0/532940664 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4011d20 con 0x7f43dc06a810 2023-10-14T11:23:34.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 -- 172.21.15.67:0/532940664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06a810 msgr2=0x7f43dc0666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 --2- 172.21.15.67:0/532940664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06a810 0x7f43dc0666a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0a1030 tx=0x7f43c4009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 -- 172.21.15.67:0/532940664 shutdown_connections 2023-10-14T11:23:34.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 --2- 172.21.15.67:0/532940664 >> v2:172.21.15.72:3300/0 conn(0x7f43dc066be0 0x7f43dc15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 --2- 172.21.15.67:0/532940664 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06a810 0x7f43dc0666a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 -- 172.21.15.67:0/532940664 >> 172.21.15.67:0/532940664 conn(0x7f43dc0b1760 msgr2=0x7f43dc0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 -- 172.21.15.67:0/532940664 shutdown_connections 2023-10-14T11:23:34.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.630+0000 7f43e1da1700 1 -- 172.21.15.67:0/532940664 wait complete. 2023-10-14T11:23:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.631+0000 7f43e1da1700 1 Processor -- start 2023-10-14T11:23:34.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.631+0000 7f43e1da1700 1 -- start start 2023-10-14T11:23:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43dc066be0 0x7f43dc1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43dc06a810 0x7f43dc156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1f4570 con 0x7f43dc06e770 2023-10-14T11:23:34.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0a07f0 con 0x7f43dc066be0 2023-10-14T11:23:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43e1da1700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1570b0 con 0x7f43dc06a810 2023-10-14T11:23:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42456/0 (socket says 172.21.15.67:42456) 2023-10-14T11:23:34.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 -- 172.21.15.67:0/761343806 learned_addr learned my addr 172.21.15.67:0/761343806 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43daffd700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43dc06a810 0x7f43dc156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43db7fe700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43dc066be0 0x7f43dc1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 -- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43dc06a810 msgr2=0x7f43dc156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43dc06a810 0x7f43dc156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 -- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43dc066be0 msgr2=0x7f43dc1f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43dc066be0 0x7f43dc1f4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 -- 172.21.15.67:0/761343806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009550 con 0x7f43dc06e770 2023-10-14T11:23:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.632+0000 7f43dbfff700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ef90 tx=0x7f43d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4009b20 con 0x7f43dc06e770 2023-10-14T11:23:34.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d400f040 con 0x7f43dc06e770 2023-10-14T11:23:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc1f6c90 con 0x7f43dc06e770 2023-10-14T11:23:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4009e50 con 0x7f43dc06e770 2023-10-14T11:23:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc1f6f30 con 0x7f43dc06e770 2023-10-14T11:23:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.633+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc04ebb0 con 0x7f43dc06e770 2023-10-14T11:23:34.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.634+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f43d4014480 con 0x7f43dc06e770 2023-10-14T11:23:34.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.634+0000 7f43d3fff700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 0x7f43bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.635+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43d408a070 con 0x7f43dc06e770 2023-10-14T11:23:34.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.635+0000 7f43db7fe700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 0x7f43bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.635+0000 7f43db7fe700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 0x7f43bc06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43dc15d2d0 tx=0x7f43cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.639+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f43d40551b0 con 0x7f43dc06e770 2023-10-14T11:23:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.842+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43dc0c6b00 con 0x7f43dc06e770 2023-10-14T11:23:34.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.842+0000 7f43d3fff700 1 -- 172.21.15.67:0/761343806 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43d4018020 con 0x7f43dc06e770 2023-10-14T11:23:34.845 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:34.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 msgr2=0x7f43bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 0x7f43bc06d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f43dc15d2d0 tx=0x7f43cc009040 comp rx=0 tx=0).stop 2023-10-14T11:23:34.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 msgr2=0x7f43dc15c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ef90 tx=0x7f43d400c3a0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 shutdown_connections 2023-10-14T11:23:34.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f43bc06af00 0x7f43bc06d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f43dc06e770 0x7f43dc15c660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43dc066be0 0x7f43dc1f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 --2- 172.21.15.67:0/761343806 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f43dc06a810 0x7f43dc156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 >> 172.21.15.67:0/761343806 conn(0x7f43dc0b1760 msgr2=0x7f43dc071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 shutdown_connections 2023-10-14T11:23:34.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.844+0000 7f43e1da1700 1 -- 172.21.15.67:0/761343806 wait complete. 2023-10-14T11:23:34.859 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:23:34.985 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.983+0000 7f75876de700 1 Processor -- start 2023-10-14T11:23:34.986 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 -- start start 2023-10-14T11:23:34.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f758006af90 0x7f7580071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758015de40 con 0x7f75800c5a10 2023-10-14T11:23:34.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758006b3f0 con 0x7f758006af90 2023-10-14T11:23:34.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.984+0000 7f75876de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c5e90 con 0x7f758015da60 2023-10-14T11:23:34.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f758006af90 0x7f7580071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f758006af90 0x7f7580071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42464/0 (socket says 172.21.15.67:42464) 2023-10-14T11:23:34.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 -- 172.21.15.67:0/264624550 learned_addr learned my addr 172.21.15.67:0/264624550 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f758547a700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 -- 172.21.15.67:0/264624550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 msgr2=0x7f75800c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 -- 172.21.15.67:0/264624550 >> v1:172.21.15.72:6789/0 conn(0x7f75800c5a10 legacy=0x7f758006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 -- 172.21.15.67:0/264624550 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75801616f0 con 0x7f758006af90 2023-10-14T11:23:34.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7585c7b700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758006af90 0x7f7580071be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7578009e50 tx=0x7f757800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccedeb46fc69321 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:34.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7577fff700 1 -- 172.21.15.67:0/264624550 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757800e070 con 0x7f758006af90 2023-10-14T11:23:34.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7577fff700 1 -- 172.21.15.67:0/264624550 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757800b9c0 con 0x7f758006af90 2023-10-14T11:23:34.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.985+0000 7f7577fff700 1 -- 172.21.15.67:0/264624550 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757800bd70 con 0x7f758006af90 2023-10-14T11:23:34.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 -- 172.21.15.67:0/264624550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758006af90 msgr2=0x7f7580071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:34.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758006af90 0x7f7580071be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7578009e50 tx=0x7f757800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:34.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 -- 172.21.15.67:0/264624550 shutdown_connections 2023-10-14T11:23:34.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f758006af90 0x7f7580071be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 --2- 172.21.15.67:0/264624550 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:34.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 -- 172.21.15.67:0/264624550 >> 172.21.15.67:0/264624550 conn(0x7f75800d0440 msgr2=0x7f75800d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:34.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 -- 172.21.15.67:0/264624550 shutdown_connections 2023-10-14T11:23:34.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.986+0000 7f75876de700 1 -- 172.21.15.67:0/264624550 wait complete. 2023-10-14T11:23:34.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.987+0000 7f75876de700 1 Processor -- start 2023-10-14T11:23:34.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.987+0000 7f75876de700 1 -- start start 2023-10-14T11:23:34.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f758006af90 0x7f75800cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:34.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800b35b0 con 0x7f75800c5a10 2023-10-14T11:23:34.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800b3aa0 con 0x7f758006af90 2023-10-14T11:23:34.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f75876de700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75800cabc0 con 0x7f758015da60 2023-10-14T11:23:34.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:34.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42468/0 (socket says 172.21.15.67:42468) 2023-10-14T11:23:35.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 -- 172.21.15.67:0/2983722316 learned_addr learned my addr 172.21.15.67:0/2983722316 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:35.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f758547a700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f758006af90 0x7f75800cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7585c7b700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 -- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 msgr2=0x7f75800b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 -- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f758006af90 msgr2=0x7f75800cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f758006af90 0x7f75800cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.988+0000 7f7584c79700 1 -- 172.21.15.67:0/2983722316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578009b30 con 0x7f75800c5a10 2023-10-14T11:23:35.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f7584c79700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f757c00c4e0 tx=0x7f757c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0052d0 con 0x7f75800c5a10 2023-10-14T11:23:35.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c005430 con 0x7f75800c5a10 2023-10-14T11:23:35.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75800caea0 con 0x7f75800c5a10 2023-10-14T11:23:35.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0038c0 con 0x7f75800c5a10 2023-10-14T11:23:35.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.989+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75800cb460 con 0x7f75800c5a10 2023-10-14T11:23:35.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.990+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758015f250 con 0x7f75800c5a10 2023-10-14T11:23:35.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.990+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f757c003a20 con 0x7f75800c5a10 2023-10-14T11:23:35.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.991+0000 7f7575ffb700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 0x7f756406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.991+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f757c088a20 con 0x7f75800c5a10 2023-10-14T11:23:35.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.991+0000 7f758547a700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 0x7f756406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.991+0000 7f758547a700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 0x7f756406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7570009930 tx=0x7f7570008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:34.995+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f757c053b60 con 0x7f75800c5a10 2023-10-14T11:23:35.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.211+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f758004ebb0 con 0x7f75800c5a10 2023-10-14T11:23:35.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.212+0000 7f7575ffb700 1 -- 172.21.15.67:0/2983722316 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f757c017080 con 0x7f75800c5a10 2023-10-14T11:23:35.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 msgr2=0x7f756406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 0x7f756406d3c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7570009930 tx=0x7f7570008040 comp rx=0 tx=0).stop 2023-10-14T11:23:35.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 msgr2=0x7f75800b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f757c00c4e0 tx=0x7f757c00c8a0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 shutdown_connections 2023-10-14T11:23:35.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f758015da60 0x7f75800b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.217 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f758006af90 0x7f75800cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f756406af00 0x7f756406d3c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 --2- 172.21.15.67:0/2983722316 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f75800c5a10 0x7f75800b0b30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 >> 172.21.15.67:0/2983722316 conn(0x7f75800d0440 msgr2=0x7f7580156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:35.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 shutdown_connections 2023-10-14T11:23:35.218 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.214+0000 7f75876de700 1 -- 172.21.15.67:0/2983722316 wait complete. 2023-10-14T11:23:35.219 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2023-10-14T11:23:35.228 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-14T11:23:35.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:35.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-14T11:23:35.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:23:35.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:35.282 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T11:23:35.325 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:35.325 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:35.343 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:35.344 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:35.403 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:23:35.403 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:35.460 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.622+0000 7fe8e0bfe700 1 Processor -- start 2023-10-14T11:23:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.622+0000 7fe8e0bfe700 1 -- start start 2023-10-14T11:23:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8e0bfe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8e0bfe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 0x7fe8dc071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8e0bfe700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8dc072410 con 0x7fe8dc15a510 2023-10-14T11:23:35.627 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8e0bfe700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8dc0cd000 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8e0bfe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc15e710 con 0x7fe8dc071a80 2023-10-14T11:23:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8d9d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8d9d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42476/0 (socket says 172.21.15.67:42476) 2023-10-14T11:23:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.623+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1811746511 learned_addr learned my addr 172.21.15.67:0/1811746511 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:35.628 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1811746511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 msgr2=0x7fe8dc071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8dad9d700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 0x7fe8dc071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d9d9b700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 0x7fe8dc071ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1811746511 >> v1:172.21.15.72:6789/0 conn(0x7fe8dc15a510 legacy=0x7fe8dc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.629 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1811746511 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc15e970 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8dad9d700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 0x7fe8dc071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d9d9b700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00bb90 tx=0x7fe8cc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f285119bb27d7459 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d959a700 1 -- 172.21.15.67:0/1811746511 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00dd50 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d959a700 1 -- 172.21.15.67:0/1811746511 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc010470 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.624+0000 7fe8d959a700 1 -- 172.21.15.67:0/1811746511 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc010800 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1811746511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 msgr2=0x7fe8dc15e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00bb90 tx=0x7fe8cc00bea0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1811746511 shutdown_connections 2023-10-14T11:23:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc071a80 0x7fe8dc071ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.631 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1811746511 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15e1d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1811746511 >> 172.21.15.67:0/1811746511 conn(0x7fe8dc0b0f60 msgr2=0x7fe8dc0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1811746511 shutdown_connections 2023-10-14T11:23:35.632 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.625+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1811746511 wait complete. 2023-10-14T11:23:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.626+0000 7fe8e0bfe700 1 Processor -- start 2023-10-14T11:23:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.626+0000 7fe8e0bfe700 1 -- start start 2023-10-14T11:23:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8dc071a80 0x7fe8dc1ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 0x7fe8dc15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc15e2f0 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc1eecc0 con 0x7fe8dc071a80 2023-10-14T11:23:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8e0bfe700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc15dd30 con 0x7fe8dc15a510 2023-10-14T11:23:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42482/0 (socket says 172.21.15.67:42482) 2023-10-14T11:23:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1776474914 learned_addr learned my addr 172.21.15.67:0/1776474914 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8dad9d700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 0x7fe8dc15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8da59c700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8dc071a80 0x7fe8dc1ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 msgr2=0x7fe8dc15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 0x7fe8dc15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8dc071a80 msgr2=0x7fe8dc1ee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8dc071a80 0x7fe8dc1ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 -- 172.21.15.67:0/1776474914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc00b7f0 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8dad9d700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 0x7fe8dc15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8d9d9b700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00bee0 tx=0x7fe8cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.627+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc01f070 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.628+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc0039b0 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.628+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc15e010 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.628+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc003d60 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.628+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc15b800 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.628+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc15bb70 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.629+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe8cc019400 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.629+0000 7fe8caffd700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 0x7fe8bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.629+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8cc08d410 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.630+0000 7fe8da59c700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 0x7fe8bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.630+0000 7fe8da59c700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 0x7fe8bc06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000f60 tx=0x7fe8d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.634+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe8cc058430 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.836+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8dc15ef00 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.837+0000 7fe8caffd700 1 -- 172.21.15.67:0/1776474914 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7fe8cc05ba50 con 0x7fe8dc0ce9e0 2023-10-14T11:23:35.839 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:35.840 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 msgr2=0x7fe8bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 0x7fe8bc06d3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000f60 tx=0x7fe8d0009040 comp rx=0 tx=0).stop 2023-10-14T11:23:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 msgr2=0x7fe8dc15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc00bee0 tx=0x7fe8cc004750 comp rx=0 tx=0).stop 2023-10-14T11:23:35.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 shutdown_connections 2023-10-14T11:23:35.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe8dc15a510 0x7fe8dc15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8dc071a80 0x7fe8dc1ee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe8bc06af00 0x7fe8bc06d3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 --2- 172.21.15.67:0/1776474914 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe8dc0ce9e0 0x7fe8dc15bd80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 >> 172.21.15.67:0/1776474914 conn(0x7fe8dc0b0f60 msgr2=0x7fe8dc0b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 shutdown_connections 2023-10-14T11:23:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.839+0000 7fe8e0bfe700 1 -- 172.21.15.67:0/1776474914 wait complete. 2023-10-14T11:23:35.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:35.855 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.981+0000 7f6f42d80700 1 Processor -- start 2023-10-14T11:23:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.981+0000 7f6f42d80700 1 -- start start 2023-10-14T11:23:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f42d80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f42d80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 0x7f6f3c06a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f42d80700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c15e640 con 0x7f6f3c0cd840 2023-10-14T11:23:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f42d80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c15e920 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f42d80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15a810 con 0x7f6f3c15b270 2023-10-14T11:23:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f3bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f4131d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 0x7f6f3c06a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f3bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42898/0 (socket says 172.21.15.67:42898) 2023-10-14T11:23:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f4131d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 0x7f6f3c06a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44764/0 (socket says 172.21.15.67:44764) 2023-10-14T11:23:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.982+0000 7f6f3bfff700 1 -- 172.21.15.67:0/3574206929 learned_addr learned my addr 172.21.15.67:0/3574206929 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3bfff700 1 -- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 msgr2=0x7f6f3c06a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3bfff700 1 --2- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 0x7f6f3c06a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3bfff700 1 -- 172.21.15.67:0/3574206929 >> v1:172.21.15.72:6789/0 conn(0x7f6f3c0cd840 legacy=0x7f6f3c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3bfff700 1 -- 172.21.15.67:0/3574206929 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0cf9a0 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3bfff700 1 --2- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009920 tx=0x7f6f30009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=325128701327b749 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3b7fe700 1 -- 172.21.15.67:0/3574206929 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011830 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3b7fe700 1 -- 172.21.15.67:0/3574206929 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30011990 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.983+0000 7f6f3b7fe700 1 -- 172.21.15.67:0/3574206929 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011d20 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 -- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c06e8f0 msgr2=0x7f6f3c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 --2- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009920 tx=0x7f6f30009c30 comp rx=0 tx=0).stop 2023-10-14T11:23:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 -- 172.21.15.67:0/3574206929 shutdown_connections 2023-10-14T11:23:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 --2- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c15b270 0x7f6f3c06a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 --2- 172.21.15.67:0/3574206929 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c06e8f0 0x7f6f3c15ad30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 -- 172.21.15.67:0/3574206929 >> 172.21.15.67:0/3574206929 conn(0x7f6f3c0b1760 msgr2=0x7f6f3c0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 -- 172.21.15.67:0/3574206929 shutdown_connections 2023-10-14T11:23:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.984+0000 7f6f42d80700 1 -- 172.21.15.67:0/3574206929 wait complete. 2023-10-14T11:23:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.985+0000 7f6f42d80700 1 Processor -- start 2023-10-14T11:23:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.985+0000 7f6f42d80700 1 -- start start 2023-10-14T11:23:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c06e8f0 0x7f6f3c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 0x7f6f3c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0cbb90 con 0x7f6f3c0cd840 2023-10-14T11:23:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0b12c0 con 0x7f6f3c15b270 2023-10-14T11:23:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f42d80700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0cb1f0 con 0x7f6f3c06e8f0 2023-10-14T11:23:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42496/0 (socket says 172.21.15.67:42496) 2023-10-14T11:23:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 -- 172.21.15.67:0/2386931052 learned_addr learned my addr 172.21.15.67:0/2386931052 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f4131d700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 0x7f6f3c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f40b1c700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c06e8f0 0x7f6f3c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 -- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c06e8f0 msgr2=0x7f6f3c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c06e8f0 0x7f6f3c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 -- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 msgr2=0x7f6f3c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 0x7f6f3c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 -- 172.21.15.67:0/2386931052 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30009550 con 0x7f6f3c0cd840 2023-10-14T11:23:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f4131d700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 0x7f6f3c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.986+0000 7f6f3bfff700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009130 tx=0x7f6f30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.987+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f300036a0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.987+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3001e070 con 0x7f6f3c0cd840 2023-10-14T11:23:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.987+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c0cb4d0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.987+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30003a60 con 0x7f6f3c0cd840 2023-10-14T11:23:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.987+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c0b0fb0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.988+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c0cbcd0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.988+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f30003bc0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.988+0000 7f6f397fa700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.989+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f3008a4e0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.989+0000 7f6f40b1c700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.989+0000 7f6f40b1c700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 0x7f6f2806d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000f60 tx=0x7f6f2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:35.993+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f3c0cbcd0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.192+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f3c0cbcd0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.193+0000 7f6f397fa700 1 -- 172.21.15.67:0/2386931052 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f3c0cbcd0 con 0x7f6f3c0cd840 2023-10-14T11:23:36.195 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 msgr2=0x7f6f2806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 0x7f6f2806d3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c000f60 tx=0x7f6f2c009040 comp rx=0 tx=0).stop 2023-10-14T11:23:36.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 msgr2=0x7f6f3c0c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009130 tx=0x7f6f30004750 comp rx=0 tx=0).stop 2023-10-14T11:23:36.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 shutdown_connections 2023-10-14T11:23:36.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f3c15b270 0x7f6f3c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f3c06e8f0 0x7f6f3c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f2806af00 0x7f6f2806d3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 --2- 172.21.15.67:0/2386931052 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f3c0cd840 0x7f6f3c0c2fb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 >> 172.21.15.67:0/2386931052 conn(0x7f6f3c0b1760 msgr2=0x7f6f3c159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 shutdown_connections 2023-10-14T11:23:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.195+0000 7f6f42d80700 1 -- 172.21.15.67:0/2386931052 wait complete. 2023-10-14T11:23:36.209 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.335+0000 7f94fdbbc700 1 Processor -- start 2023-10-14T11:23:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.335+0000 7f94fdbbc700 1 -- start start 2023-10-14T11:23:36.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94fdbbc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f94f80b1140 0x7f94f806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94fdbbc700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f815cd20 con 0x7f94f815f4d0 2023-10-14T11:23:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94fdbbc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f80b15d0 con 0x7f94f80b08d0 2023-10-14T11:23:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94fdbbc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f815bee0 con 0x7f94f80b1140 2023-10-14T11:23:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94f7fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f94f815f4d0 0x7f94f80cf6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41800/0 (socket says 172.21.15.67:41800) 2023-10-14T11:23:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94f7fff700 1 -- 172.21.15.67:0/4090820703 learned_addr learned my addr 172.21.15.67:0/4090820703 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.336+0000 7f94f6ffd700 1 --2- 172.21.15.67:0/4090820703 >> v2:172.21.15.72:3300/0 conn(0x7f94f80b1140 0x7f94f806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f67fc700 1 -- 172.21.15.67:0/4090820703 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647451023 0 0) 0x7f94f815cd20 con 0x7f94f815f4d0 2023-10-14T11:23:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f67fc700 1 -- 172.21.15.67:0/4090820703 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e40035b0 con 0x7f94f815f4d0 2023-10-14T11:23:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f6ffd700 1 -- 172.21.15.67:0/4090820703 >> v1:172.21.15.72:6789/0 conn(0x7f94f80b08d0 legacy=0x7f94f815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f6ffd700 1 -- 172.21.15.67:0/4090820703 >> v1:172.21.15.67:6789/0 conn(0x7f94f815f4d0 legacy=0x7f94f80cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f6ffd700 1 -- 172.21.15.67:0/4090820703 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f80b18b0 con 0x7f94f80b1140 2023-10-14T11:23:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f6ffd700 1 --2- 172.21.15.67:0/4090820703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f80b1140 0x7f94f806b1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009840 tx=0x7f94e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f28ccd3b29bc4efc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f67fc700 1 -- 172.21.15.67:0/4090820703 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8011830 con 0x7f94f80b1140 2023-10-14T11:23:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f67fc700 1 -- 172.21.15.67:0/4090820703 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8011990 con 0x7f94f80b1140 2023-10-14T11:23:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.337+0000 7f94f67fc700 1 -- 172.21.15.67:0/4090820703 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8011d20 con 0x7f94f80b1140 2023-10-14T11:23:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 -- 172.21.15.67:0/4090820703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f80b1140 msgr2=0x7f94f806b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/4090820703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f80b1140 0x7f94f806b1e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009840 tx=0x7f94e8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 -- 172.21.15.67:0/4090820703 shutdown_connections 2023-10-14T11:23:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/4090820703 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f80b1140 0x7f94f806b1e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.344 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 -- 172.21.15.67:0/4090820703 >> 172.21.15.67:0/4090820703 conn(0x7f94f80d04b0 msgr2=0x7f94f80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 -- 172.21.15.67:0/4090820703 shutdown_connections 2023-10-14T11:23:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.338+0000 7f94fdbbc700 1 -- 172.21.15.67:0/4090820703 wait complete. 2023-10-14T11:23:36.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.339+0000 7f94fdbbc700 1 Processor -- start 2023-10-14T11:23:36.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.339+0000 7f94fdbbc700 1 -- start start 2023-10-14T11:23:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94f80b08d0 0x7f94f81f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 0x7f94f80c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80ad420 con 0x7f94f80c6050 2023-10-14T11:23:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80c64f0 con 0x7f94f815f4d0 2023-10-14T11:23:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94fdbbc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80c67d0 con 0x7f94f80b08d0 2023-10-14T11:23:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.340+0000 7f94f7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42512/0 (socket says 172.21.15.67:42512) 2023-10-14T11:23:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 -- 172.21.15.67:0/521284853 learned_addr learned my addr 172.21.15.67:0/521284853 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f6ffd700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 0x7f94f80c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f77fe700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94f80b08d0 0x7f94f81f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 -- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94f80b08d0 msgr2=0x7f94f81f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94f80b08d0 0x7f94f81f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 -- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 msgr2=0x7f94f80c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 0x7f94f80c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 -- 172.21.15.67:0/521284853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e80094a0 con 0x7f94f80c6050 2023-10-14T11:23:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f6ffd700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 0x7f94f80c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94f7fff700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cb40 tx=0x7f94f000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f000ab50 con 0x7f94f80c6050 2023-10-14T11:23:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f000acb0 con 0x7f94f80c6050 2023-10-14T11:23:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f80c6ab0 con 0x7f94f80c6050 2023-10-14T11:23:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0012620 con 0x7f94f80c6050 2023-10-14T11:23:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.341+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f81f10b0 con 0x7f94f80c6050 2023-10-14T11:23:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.342+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f80ad590 con 0x7f94f80c6050 2023-10-14T11:23:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.343+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94f001b3b0 con 0x7f94f80c6050 2023-10-14T11:23:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.343+0000 7f94effff700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 0x7f94d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.343+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94f0089410 con 0x7f94f80c6050 2023-10-14T11:23:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.343+0000 7f94f77fe700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 0x7f94d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.344+0000 7f94f77fe700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 0x7f94d806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000f60 tx=0x7f94e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.348+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94f00544c0 con 0x7f94f80c6050 2023-10-14T11:23:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.550+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94f804ebb0 con 0x7f94f80c6050 2023-10-14T11:23:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.551+0000 7f94effff700 1 -- 172.21.15.67:0/521284853 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94f0057ae0 con 0x7f94f80c6050 2023-10-14T11:23:36.553 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 msgr2=0x7f94d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 0x7f94d806d3c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f94e0000f60 tx=0x7f94e0009040 comp rx=0 tx=0).stop 2023-10-14T11:23:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 msgr2=0x7f94f80b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94f000cb40 tx=0x7f94f000cf00 comp rx=0 tx=0).stop 2023-10-14T11:23:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 shutdown_connections 2023-10-14T11:23:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f94d806af00 0x7f94d806d3c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f94f80c6050 0x7f94f80b25a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f94f80b08d0 0x7f94f81f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 --2- 172.21.15.67:0/521284853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f94f815f4d0 0x7f94f80c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 >> 172.21.15.67:0/521284853 conn(0x7f94f80d04b0 msgr2=0x7f94f8073890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 shutdown_connections 2023-10-14T11:23:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.553+0000 7f94fdbbc700 1 -- 172.21.15.67:0/521284853 wait complete. 2023-10-14T11:23:36.567 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:36.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.693+0000 7f62a4fda700 1 Processor -- start 2023-10-14T11:23:36.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.693+0000 7f62a4fda700 1 -- start start 2023-10-14T11:23:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f62a4fda700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a0072360 0x7f62a0161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f62a4fda700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a00667b0 con 0x7f62a00cbdc0 2023-10-14T11:23:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f62a4fda700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a00b2280 con 0x7f62a015d920 2023-10-14T11:23:36.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f62a4fda700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00ca9d0 con 0x7f62a0072360 2023-10-14T11:23:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f629ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a0072360 0x7f62a0161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f629dd9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f62a00cbdc0 0x7f62a00cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41810/0 (socket says 172.21.15.67:41810) 2023-10-14T11:23:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f629ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f62a0072360 0x7f62a0161b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42518/0 (socket says 172.21.15.67:42518) 2023-10-14T11:23:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.694+0000 7f629dd9b700 1 -- 172.21.15.67:0/841398399 learned_addr learned my addr 172.21.15.67:0/841398399 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629ed9d700 1 -- 172.21.15.67:0/841398399 >> v1:172.21.15.72:6789/0 conn(0x7f62a015d920 legacy=0x7f62a00ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629ed9d700 1 -- 172.21.15.67:0/841398399 >> v1:172.21.15.67:6789/0 conn(0x7f62a00cbdc0 legacy=0x7f62a00cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629d59a700 1 -- 172.21.15.67:0/841398399 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796682961 0 0) 0x7f62a00667b0 con 0x7f62a00cbdc0 2023-10-14T11:23:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629ed9d700 1 -- 172.21.15.67:0/841398399 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a01616d0 con 0x7f62a0072360 2023-10-14T11:23:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629ed9d700 1 --2- 172.21.15.67:0/841398399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a0072360 0x7f62a0161b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6298009d90 tx=0x7f629800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad163c11e92d51f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629d59a700 1 -- 172.21.15.67:0/841398399 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629800e070 con 0x7f62a0072360 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629d59a700 1 -- 172.21.15.67:0/841398399 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629800bb90 con 0x7f62a0072360 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f629d59a700 1 -- 172.21.15.67:0/841398399 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298003a20 con 0x7f62a0072360 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f62a4fda700 1 -- 172.21.15.67:0/841398399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a0072360 msgr2=0x7f62a0161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.695+0000 7f62a4fda700 1 --2- 172.21.15.67:0/841398399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a0072360 0x7f62a0161b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6298009d90 tx=0x7f629800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.696+0000 7f62a4fda700 1 -- 172.21.15.67:0/841398399 shutdown_connections 2023-10-14T11:23:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.696+0000 7f62a4fda700 1 --2- 172.21.15.67:0/841398399 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a0072360 0x7f62a0161b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.696+0000 7f62a4fda700 1 -- 172.21.15.67:0/841398399 >> 172.21.15.67:0/841398399 conn(0x7f62a00b1760 msgr2=0x7f62a00b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.696+0000 7f62a4fda700 1 -- 172.21.15.67:0/841398399 shutdown_connections 2023-10-14T11:23:36.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.696+0000 7f62a4fda700 1 -- 172.21.15.67:0/841398399 wait complete. 2023-10-14T11:23:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.697+0000 7f62a4fda700 1 Processor -- start 2023-10-14T11:23:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.697+0000 7f62a4fda700 1 -- start start 2023-10-14T11:23:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62a0072360 0x7f62a00c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62a015d920 0x7f62a01f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c8980 con 0x7f62a01f4740 2023-10-14T11:23:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c8c60 con 0x7f62a0072360 2023-10-14T11:23:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f62a4fda700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c8f40 con 0x7f62a015d920 2023-10-14T11:23:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42524/0 (socket says 172.21.15.67:42524) 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 -- 172.21.15.67:0/1701463356 learned_addr learned my addr 172.21.15.67:0/1701463356 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629e59c700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62a0072360 0x7f62a00c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629dd9b700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62a015d920 0x7f62a01f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 -- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62a015d920 msgr2=0x7f62a01f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62a015d920 0x7f62a01f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 -- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62a0072360 msgr2=0x7f62a00c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62a0072360 0x7f62a00c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 -- 172.21.15.67:0/1701463356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009a70 con 0x7f62a01f4740 2023-10-14T11:23:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f629ed9d700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6298004000 tx=0x7f6298004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.698+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298012630 con 0x7f62a01f4740 2023-10-14T11:23:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.699+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62980127b0 con 0x7f62a01f4740 2023-10-14T11:23:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.699+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a00c9220 con 0x7f62a01f4740 2023-10-14T11:23:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.699+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298012b60 con 0x7f62a01f4740 2023-10-14T11:23:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.699+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a00c9c80 con 0x7f62a01f4740 2023-10-14T11:23:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.699+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a00c8ac0 con 0x7f62a01f4740 2023-10-14T11:23:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.700+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6298012cc0 con 0x7f62a01f4740 2023-10-14T11:23:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.700+0000 7f628effd700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 0x7f628006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.700+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f629808b680 con 0x7f62a01f4740 2023-10-14T11:23:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.701+0000 7f629e59c700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 0x7f628006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.701+0000 7f629e59c700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 0x7f628006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6294009960 tx=0x7f62940090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.705+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62a00c8ac0 con 0x7f62a01f4740 2023-10-14T11:23:36.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.908+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62a00c8ac0 con 0x7f62a01f4740 2023-10-14T11:23:36.911 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.908+0000 7f628effd700 1 -- 172.21.15.67:0/1701463356 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62a00c8ac0 con 0x7f62a01f4740 2023-10-14T11:23:36.911 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:36.912 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 msgr2=0x7f628006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 0x7f628006d3c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6294009960 tx=0x7f62940090e0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 msgr2=0x7f62a00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6298004000 tx=0x7f6298004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 shutdown_connections 2023-10-14T11:23:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f628006af00 0x7f628006d3c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f62a01f4740 0x7f62a00c9740 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62a0072360 0x7f62a00c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 --2- 172.21.15.67:0/1701463356 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f62a015d920 0x7f62a01f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:36.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.910+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 >> 172.21.15.67:0/1701463356 conn(0x7f62a00b1760 msgr2=0x7f62a00b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.911+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 shutdown_connections 2023-10-14T11:23:36.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:36.911+0000 7f62a4fda700 1 -- 172.21.15.67:0/1701463356 wait complete. 2023-10-14T11:23:36.925 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:23:37.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.049+0000 7f7e5389a700 1 Processor -- start 2023-10-14T11:23:37.051 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.049+0000 7f7e5389a700 1 -- start start 2023-10-14T11:23:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e4c0cdc30 0x7f7e4c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 0x7f7e4c0d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c0cef10 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4c0d2090 con 0x7f7e4c0cdc30 2023-10-14T11:23:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e5389a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c15deb0 con 0x7f7e4c0cffe0 2023-10-14T11:23:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42528/0 (socket says 172.21.15.67:42528) 2023-10-14T11:23:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 -- 172.21.15.67:0/225065770 learned_addr learned my addr 172.21.15.67:0/225065770 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e50e35700 1 --2- 172.21.15.67:0/225065770 >> v2:172.21.15.72:3300/0 conn(0x7f7e4c0cdc30 0x7f7e4c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51e37700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 0x7f7e4c0d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 -- 172.21.15.67:0/225065770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 msgr2=0x7f7e4c0d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 0x7f7e4c0d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 -- 172.21.15.67:0/225065770 >> v2:172.21.15.72:3300/0 conn(0x7f7e4c0cdc30 msgr2=0x7f7e4c0cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 --2- 172.21.15.67:0/225065770 >> v2:172.21.15.72:3300/0 conn(0x7f7e4c0cdc30 0x7f7e4c0cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51636700 1 -- 172.21.15.67:0/225065770 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c0d22e0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.050+0000 7f7e51e37700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 0x7f7e4c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e51636700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c072be0 tx=0x7f7e3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afddb98ccc0d8b58 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e43fff700 1 -- 172.21.15.67:0/225065770 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00b870 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e43fff700 1 -- 172.21.15.67:0/225065770 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00b9d0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e43fff700 1 -- 172.21.15.67:0/225065770 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00bd60 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 -- 172.21.15.67:0/225065770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 msgr2=0x7f7e4c0b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c072be0 tx=0x7f7e3c009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 -- 172.21.15.67:0/225065770 shutdown_connections 2023-10-14T11:23:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cffe0 0x7f7e4c0d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 --2- 172.21.15.67:0/225065770 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c0b04c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 --2- 172.21.15.67:0/225065770 >> v2:172.21.15.72:3300/0 conn(0x7f7e4c0cdc30 0x7f7e4c0cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 -- 172.21.15.67:0/225065770 >> 172.21.15.67:0/225065770 conn(0x7f7e4c0d1570 msgr2=0x7f7e4c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 -- 172.21.15.67:0/225065770 shutdown_connections 2023-10-14T11:23:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.051+0000 7f7e5389a700 1 -- 172.21.15.67:0/225065770 wait complete. 2023-10-14T11:23:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 Processor -- start 2023-10-14T11:23:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 -- start start 2023-10-14T11:23:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cdc30 0x7f7e4c1f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e4c0cffe0 0x7f7e4c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0c7a20 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c0c7740 con 0x7f7e4c0cffe0 2023-10-14T11:23:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.053+0000 7f7e5389a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c1f4720 con 0x7f7e4c0cdc30 2023-10-14T11:23:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42536/0 (socket says 172.21.15.67:42536) 2023-10-14T11:23:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 -- 172.21.15.67:0/166319897 learned_addr learned my addr 172.21.15.67:0/166319897 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e51636700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cdc30 0x7f7e4c1f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e51e37700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e4c0cffe0 0x7f7e4c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 -- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cdc30 msgr2=0x7f7e4c1f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cdc30 0x7f7e4c1f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 -- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e4c0cffe0 msgr2=0x7f7e4c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e4c0cffe0 0x7f7e4c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 -- 172.21.15.67:0/166319897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009550 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e50e35700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800d800 tx=0x7f7e4800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e480125f0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48012750 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c1f4a00 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48012ae0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.054+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c0c8720 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.055+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c0d0950 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.056+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7e48012c40 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.056+0000 7f7e41ffb700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 0x7f7e3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.056+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e480895d0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.056+0000 7f7e51636700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 0x7f7e3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.057+0000 7f7e51636700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 0x7f7e3006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c014040 tx=0x7f7e3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.061+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7e480545e0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.279+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e4c04ebb0 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.279+0000 7f7e41ffb700 1 -- 172.21.15.67:0/166319897 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e48057c00 con 0x7f7e4c0ceb30 2023-10-14T11:23:37.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 msgr2=0x7f7e3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 0x7f7e3006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c014040 tx=0x7f7e3c008030 comp rx=0 tx=0).stop 2023-10-14T11:23:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 msgr2=0x7f7e4c1f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800d800 tx=0x7f7e4800db10 comp rx=0 tx=0).stop 2023-10-14T11:23:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 shutdown_connections 2023-10-14T11:23:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e4c0cffe0 0x7f7e4c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7e4c0cdc30 0x7f7e4c1f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7e3006af00 0x7f7e3006d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 --2- 172.21.15.67:0/166319897 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7e4c0ceb30 0x7f7e4c1f1b10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 >> 172.21.15.67:0/166319897 conn(0x7f7e4c0d1570 msgr2=0x7f7e4c070570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 shutdown_connections 2023-10-14T11:23:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.281+0000 7f7e5389a700 1 -- 172.21.15.67:0/166319897 wait complete. 2023-10-14T11:23:37.286 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2023-10-14T11:23:37.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-14T11:23:37.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:37.296 DEBUG:teuthology.orchestra.run.smithi067:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-14T11:23:37.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:23:37.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:37.343 DEBUG:teuthology.orchestra.run.smithi067:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T11:23:37.361 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:37.361 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:37.383 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:37.384 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:37.446 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:23:37.446 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:23:37.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.631+0000 7f962e533700 1 Processor -- start 2023-10-14T11:23:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.631+0000 7f962e533700 1 -- start start 2023-10-14T11:23:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f962e533700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f962815e4a0 0x7f96280cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f962e533700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96280c52c0 0x7f96280c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f962e533700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280cfa80 con 0x7f962815e0c0 2023-10-14T11:23:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f962e533700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280cfd60 con 0x7f962815e4a0 2023-10-14T11:23:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f962e533700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96280d0040 con 0x7f96280c52c0 2023-10-14T11:23:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f962815e4a0 0x7f96280cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f9627fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f962815e0c0 0x7f9628072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41834/0 (socket says 172.21.15.67:41834) 2023-10-14T11:23:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f9627fff700 1 -- 172.21.15.67:0/4281848854 learned_addr learned my addr 172.21.15.67:0/4281848854 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 -- 172.21.15.67:0/4281848854 >> v2:172.21.15.72:3300/0 conn(0x7f96280c52c0 msgr2=0x7f96280c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 --2- 172.21.15.67:0/4281848854 >> v2:172.21.15.72:3300/0 conn(0x7f96280c52c0 0x7f96280c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 -- 172.21.15.67:0/4281848854 >> v1:172.21.15.67:6789/0 conn(0x7f962815e0c0 legacy=0x7f9628072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 -- 172.21.15.67:0/4281848854 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962806f570 con 0x7f962815e4a0 2023-10-14T11:23:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f9626ffd700 1 -- 172.21.15.67:0/4281848854 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006024013 0 0) 0x7f96280cfa80 con 0x7f962815e0c0 2023-10-14T11:23:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.632+0000 7f96277fe700 1 --2- 172.21.15.67:0/4281848854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962815e4a0 0x7f96280cf1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9618009840 tx=0x7f9618009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b18b5baba3c974 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f9626ffd700 1 -- 172.21.15.67:0/4281848854 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618011830 con 0x7f962815e4a0 2023-10-14T11:23:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f9626ffd700 1 -- 172.21.15.67:0/4281848854 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618011990 con 0x7f962815e4a0 2023-10-14T11:23:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f9626ffd700 1 -- 172.21.15.67:0/4281848854 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9618011d20 con 0x7f962815e4a0 2023-10-14T11:23:37.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 -- 172.21.15.67:0/4281848854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962815e4a0 msgr2=0x7f96280cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 --2- 172.21.15.67:0/4281848854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962815e4a0 0x7f96280cf1c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9618009840 tx=0x7f9618009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:37.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 -- 172.21.15.67:0/4281848854 shutdown_connections 2023-10-14T11:23:37.639 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 --2- 172.21.15.67:0/4281848854 >> v2:172.21.15.72:3300/0 conn(0x7f96280c52c0 0x7f96280c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 --2- 172.21.15.67:0/4281848854 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f962815e4a0 0x7f96280cf1c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 -- 172.21.15.67:0/4281848854 >> 172.21.15.67:0/4281848854 conn(0x7f96280d0440 msgr2=0x7f96280d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:37.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 -- 172.21.15.67:0/4281848854 shutdown_connections 2023-10-14T11:23:37.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.633+0000 7f962e533700 1 -- 172.21.15.67:0/4281848854 wait complete. 2023-10-14T11:23:37.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.634+0000 7f962e533700 1 Processor -- start 2023-10-14T11:23:37.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 -- start start 2023-10-14T11:23:37.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962815e0c0 0x7f962814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f962815e4a0 0x7f962815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962814f160 con 0x7f96280c52c0 2023-10-14T11:23:37.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628153460 con 0x7f962815e4a0 2023-10-14T11:23:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f962e533700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628153740 con 0x7f962815e0c0 2023-10-14T11:23:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f9627fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f9627fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42546/0 (socket says 172.21.15.67:42546) 2023-10-14T11:23:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.635+0000 7f9627fff700 1 -- 172.21.15.67:0/3399518068 learned_addr learned my addr 172.21.15.67:0/3399518068 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f96277fe700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962815e0c0 0x7f962814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f962cad0700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f962815e4a0 0x7f962815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 -- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962815e0c0 msgr2=0x7f962814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962815e0c0 0x7f962814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 -- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f962815e4a0 msgr2=0x7f962815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f962815e4a0 0x7f962815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 -- 172.21.15.67:0/3399518068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180094a0 con 0x7f96280c52c0 2023-10-14T11:23:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9627fff700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f961c0011e0 tx=0x7f961c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c004c80 con 0x7f96280c52c0 2023-10-14T11:23:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961c004e00 con 0x7f96280c52c0 2023-10-14T11:23:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628153a20 con 0x7f96280c52c0 2023-10-14T11:23:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961c007310 con 0x7f96280c52c0 2023-10-14T11:23:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.636+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9628153fe0 con 0x7f96280c52c0 2023-10-14T11:23:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.637+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96281541d0 con 0x7f96280c52c0 2023-10-14T11:23:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.638+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f961c007470 con 0x7f96280c52c0 2023-10-14T11:23:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.638+0000 7f9624ff9700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 0x7f961406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.638+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f961c089280 con 0x7f96280c52c0 2023-10-14T11:23:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.638+0000 7f96277fe700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 0x7f961406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.639+0000 7f96277fe700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 0x7f961406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f96180090b0 tx=0x7f9618008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.642+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f961c054330 con 0x7f96280c52c0 2023-10-14T11:23:37.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.846+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f962804ebb0 con 0x7f96280c52c0 2023-10-14T11:23:37.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.847+0000 7f9624ff9700 1 -- 172.21.15.67:0/3399518068 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f961c057950 con 0x7f96280c52c0 2023-10-14T11:23:37.849 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:37.850 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 msgr2=0x7f961406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 0x7f961406d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f96180090b0 tx=0x7f9618008030 comp rx=0 tx=0).stop 2023-10-14T11:23:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 msgr2=0x7f9628154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f961c0011e0 tx=0x7f961c00ca30 comp rx=0 tx=0).stop 2023-10-14T11:23:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 shutdown_connections 2023-10-14T11:23:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f962815e4a0 0x7f962815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f961406af00 0x7f961406d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96280c52c0 0x7f9628154500 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 --2- 172.21.15.67:0/3399518068 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f962815e0c0 0x7f962814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 >> 172.21.15.67:0/3399518068 conn(0x7f96280d0440 msgr2=0x7f96280b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 shutdown_connections 2023-10-14T11:23:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.849+0000 7f962e533700 1 -- 172.21.15.67:0/3399518068 wait complete. 2023-10-14T11:23:37.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:37.865 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.991+0000 7f35e041c700 1 Processor -- start 2023-10-14T11:23:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.991+0000 7f35e041c700 1 -- start start 2023-10-14T11:23:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35e041c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35d80b0bb0 0x7f35d80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35e041c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35d80b1250 0x7f35d80b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35e041c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d80b0f90 con 0x7f35d806b3b0 2023-10-14T11:23:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35e041c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d80cde00 con 0x7f35d80b0bb0 2023-10-14T11:23:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35e041c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d80b1bc0 con 0x7f35d80b1250 2023-10-14T11:23:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35d80b0bb0 0x7f35d80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35dd9b7700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f35d806b3b0 0x7f35d80cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41848/0 (socket says 172.21.15.67:41848) 2023-10-14T11:23:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f35d80b0bb0 0x7f35d80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42554/0 (socket says 172.21.15.67:42554) 2023-10-14T11:23:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35dd9b7700 1 -- 172.21.15.67:0/1173377567 learned_addr learned my addr 172.21.15.67:0/1173377567 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de9b9700 1 --2- 172.21.15.67:0/1173377567 >> v2:172.21.15.72:3300/0 conn(0x7f35d80b1250 0x7f35d80b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 -- 172.21.15.67:0/1173377567 >> v2:172.21.15.72:3300/0 conn(0x7f35d80b1250 msgr2=0x7f35d80b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 --2- 172.21.15.67:0/1173377567 >> v2:172.21.15.72:3300/0 conn(0x7f35d80b1250 0x7f35d80b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 -- 172.21.15.67:0/1173377567 >> v1:172.21.15.67:6789/0 conn(0x7f35d806b3b0 legacy=0x7f35d80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.992+0000 7f35de1b8700 1 -- 172.21.15.67:0/1173377567 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80cc820 con 0x7f35d80b0bb0 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35de1b8700 1 --2- 172.21.15.67:0/1173377567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d80cd8c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35d8161660 tx=0x7f35d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14825dc3a3aa7bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35dd1b6700 1 -- 172.21.15.67:0/1173377567 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011830 con 0x7f35d80b0bb0 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35dd1b6700 1 -- 172.21.15.67:0/1173377567 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4011990 con 0x7f35d80b0bb0 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35dd1b6700 1 -- 172.21.15.67:0/1173377567 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011d20 con 0x7f35d80b0bb0 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 -- 172.21.15.67:0/1173377567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 msgr2=0x7f35d80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 --2- 172.21.15.67:0/1173377567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d80cd8c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35d8161660 tx=0x7f35d4009b20 comp rx=0 tx=0).stop 2023-10-14T11:23:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 -- 172.21.15.67:0/1173377567 shutdown_connections 2023-10-14T11:23:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 --2- 172.21.15.67:0/1173377567 >> v2:172.21.15.72:3300/0 conn(0x7f35d80b1250 0x7f35d80b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 --2- 172.21.15.67:0/1173377567 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d80cd8c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 -- 172.21.15.67:0/1173377567 >> 172.21.15.67:0/1173377567 conn(0x7f35d80d04b0 msgr2=0x7f35d80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 -- 172.21.15.67:0/1173377567 shutdown_connections 2023-10-14T11:23:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.993+0000 7f35e041c700 1 -- 172.21.15.67:0/1173377567 wait complete. 2023-10-14T11:23:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 Processor -- start 2023-10-14T11:23:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 -- start start 2023-10-14T11:23:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35d806b3b0 0x7f35d81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35d80b1250 0x7f35d80b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d8153410 con 0x7f35d80b0bb0 2023-10-14T11:23:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80ad200 con 0x7f35d806b3b0 2023-10-14T11:23:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.995+0000 7f35e041c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d81f3270 con 0x7f35d80b1250 2023-10-14T11:23:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42562/0 (socket says 172.21.15.67:42562) 2023-10-14T11:23:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 -- 172.21.15.67:0/2128123395 learned_addr learned my addr 172.21.15.67:0/2128123395 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35de1b8700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35d806b3b0 0x7f35d81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35de9b9700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35d80b1250 0x7f35d80b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 -- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35d80b1250 msgr2=0x7f35d80b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35d80b1250 0x7f35d80b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 -- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35d806b3b0 msgr2=0x7f35d81f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35d806b3b0 0x7f35d81f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 -- 172.21.15.67:0/2128123395 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40094a0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35dd9b7700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c520 tx=0x7f35c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8005d70 con 0x7f35d80b0bb0 2023-10-14T11:23:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c80070d0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d80ad450 con 0x7f35d80b0bb0 2023-10-14T11:23:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8007440 con 0x7f35d80b0bb0 2023-10-14T11:23:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.996+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d80ada10 con 0x7f35d80b0bb0 2023-10-14T11:23:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.997+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d804ebb0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.998+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35c80075a0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.998+0000 7f35ceffd700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 0x7f35bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.998+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35c80888d0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.998+0000 7f35de1b8700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 0x7f35bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:37.999+0000 7f35de1b8700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 0x7f35bc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35d40090b0 tx=0x7f35d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.003+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35c8053990 con 0x7f35d80b0bb0 2023-10-14T11:23:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.200+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d806c710 con 0x7f35d80b0bb0 2023-10-14T11:23:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.200+0000 7f35ceffd700 1 -- 172.21.15.67:0/2128123395 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c80170a0 con 0x7f35d80b0bb0 2023-10-14T11:23:38.203 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 msgr2=0x7f35bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 0x7f35bc06d3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35d40090b0 tx=0x7f35d4008030 comp rx=0 tx=0).stop 2023-10-14T11:23:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 msgr2=0x7f35d815e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f35c800c520 tx=0x7f35c800c830 comp rx=0 tx=0).stop 2023-10-14T11:23:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 shutdown_connections 2023-10-14T11:23:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f35d80b1250 0x7f35d80b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35d806b3b0 0x7f35d81f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f35bc06af00 0x7f35bc06d3c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 --2- 172.21.15.67:0/2128123395 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f35d80b0bb0 0x7f35d815e220 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 >> 172.21.15.67:0/2128123395 conn(0x7f35d80d04b0 msgr2=0x7f35d80cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 shutdown_connections 2023-10-14T11:23:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.203+0000 7f35e041c700 1 -- 172.21.15.67:0/2128123395 wait complete. 2023-10-14T11:23:38.217 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.344+0000 7f9700f75700 1 Processor -- start 2023-10-14T11:23:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.344+0000 7f9700f75700 1 -- start start 2023-10-14T11:23:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.344+0000 7f9700f75700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96fc15d920 0x7f96fc0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.344+0000 7f9700f75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f9700f75700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc0667b0 con 0x7f96fc072360 2023-10-14T11:23:38.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f9700f75700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0b2280 con 0x7f96fc15d920 2023-10-14T11:23:38.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f9700f75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc1616d0 con 0x7f96fc0cbdc0 2023-10-14T11:23:38.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96f9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96fc15d920 0x7f96fc0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96fc15d920 0x7f96fc0ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:42976/0 (socket says 172.21.15.67:42976) 2023-10-14T11:23:38.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96f9d9b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44840/0 (socket says 172.21.15.67:44840) 2023-10-14T11:23:38.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f96fc072360 0x7f96fc161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48688/0 (socket says 172.21.15.67:48688) 2023-10-14T11:23:38.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 -- 172.21.15.67:0/43271647 learned_addr learned my addr 172.21.15.67:0/43271647 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 -- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 msgr2=0x7f96fc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 -- 172.21.15.67:0/43271647 >> v1:172.21.15.72:6789/0 conn(0x7f96fc072360 legacy=0x7f96fc161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 -- 172.21.15.67:0/43271647 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc066a00 con 0x7f96fc15d920 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96f9d9b700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:38.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.345+0000 7f96fa59c700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc15d920 0x7f96fc0ca2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0098f0 tx=0x7f96ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=773a54d450470578 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f96f959a700 1 -- 172.21.15.67:0/43271647 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec011830 con 0x7f96fc15d920 2023-10-14T11:23:38.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f96f959a700 1 -- 172.21.15.67:0/43271647 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec011990 con 0x7f96fc15d920 2023-10-14T11:23:38.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f96f959a700 1 -- 172.21.15.67:0/43271647 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec011d20 con 0x7f96fc15d920 2023-10-14T11:23:38.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 -- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc15d920 msgr2=0x7f96fc0ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc15d920 0x7f96fc0ca2c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0098f0 tx=0x7f96ec009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 -- 172.21.15.67:0/43271647 shutdown_connections 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc15d920 0x7f96fc0ca2c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 --2- 172.21.15.67:0/43271647 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc0cbdc0 0x7f96fc0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 -- 172.21.15.67:0/43271647 >> 172.21.15.67:0/43271647 conn(0x7f96fc0b1760 msgr2=0x7f96fc0b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 -- 172.21.15.67:0/43271647 shutdown_connections 2023-10-14T11:23:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.346+0000 7f9700f75700 1 -- 172.21.15.67:0/43271647 wait complete. 2023-10-14T11:23:38.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 Processor -- start 2023-10-14T11:23:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 -- start start 2023-10-14T11:23:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc072360 0x7f96fc15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc15d920 0x7f96fc0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc1e8390 con 0x7f96fc0c6510 2023-10-14T11:23:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc1e7710 con 0x7f96fc072360 2023-10-14T11:23:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f9700f75700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc1e79f0 con 0x7f96fc15d920 2023-10-14T11:23:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f96fad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f96fad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42578/0 (socket says 172.21.15.67:42578) 2023-10-14T11:23:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.348+0000 7f96fad9d700 1 -- 172.21.15.67:0/1079738046 learned_addr learned my addr 172.21.15.67:0/1079738046 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fa59c700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc072360 0x7f96fc15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96f9d9b700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc15d920 0x7f96fc0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 -- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc15d920 msgr2=0x7f96fc0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc15d920 0x7f96fc0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 -- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc072360 msgr2=0x7f96fc15dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc072360 0x7f96fc15dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 -- 172.21.15.67:0/1079738046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f00094a0 con 0x7f96fc0c6510 2023-10-14T11:23:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96fad9d700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96f400cbc0 tx=0x7f96f400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400abb0 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f400ad10 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec009550 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4007270 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.349+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc1e7fb0 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.351+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f96f40073d0 con 0x7f96fc0c6510 2023-10-14T11:23:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.351+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc1e84d0 con 0x7f96fc0c6510 2023-10-14T11:23:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.351+0000 7f96eaffd700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.351+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96f4089270 con 0x7f96fc0c6510 2023-10-14T11:23:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.351+0000 7f96fa59c700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.352+0000 7f96fa59c700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 0x7f96dc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96ec014040 tx=0x7f96ec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.356+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f96fc1e84d0 con 0x7f96fc0c6510 2023-10-14T11:23:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.557+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96fc1e84d0 con 0x7f96fc0c6510 2023-10-14T11:23:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.557+0000 7f96eaffd700 1 -- 172.21.15.67:0/1079738046 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96fc1e84d0 con 0x7f96fc0c6510 2023-10-14T11:23:38.559 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:38.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 msgr2=0x7f96dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 0x7f96dc06d3c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96ec014040 tx=0x7f96ec008030 comp rx=0 tx=0).stop 2023-10-14T11:23:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 msgr2=0x7f96fc09f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96f400cbc0 tx=0x7f96f400cf80 comp rx=0 tx=0).stop 2023-10-14T11:23:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 shutdown_connections 2023-10-14T11:23:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f96dc06af00 0x7f96dc06d3c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f96fc0c6510 0x7f96fc09f2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96fc072360 0x7f96fc15dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 --2- 172.21.15.67:0/1079738046 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f96fc15d920 0x7f96fc0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 >> 172.21.15.67:0/1079738046 conn(0x7f96fc0b1760 msgr2=0x7f96fc06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 shutdown_connections 2023-10-14T11:23:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.559+0000 7f9700f75700 1 -- 172.21.15.67:0/1079738046 wait complete. 2023-10-14T11:23:38.573 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.702+0000 7fddffbc6700 1 Processor -- start 2023-10-14T11:23:38.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.702+0000 7fddffbc6700 1 -- start start 2023-10-14T11:23:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 0x7fddf80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 0x7fddf80cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddf80cfeb0 0x7fddf80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80cde00 con 0x7fddf80cfeb0 2023-10-14T11:23:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80b0f90 con 0x7fddf806b3b0 2023-10-14T11:23:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddffbc6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80cc820 con 0x7fddf80b0bb0 2023-10-14T11:23:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddf80cfeb0 0x7fddf80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fddf80cfeb0 0x7fddf80b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42586/0 (socket says 172.21.15.67:42586) 2023-10-14T11:23:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 -- 172.21.15.67:0/827860566 learned_addr learned my addr 172.21.15.67:0/827860566 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfd161700 1 --2- 172.21.15.67:0/827860566 >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 0x7fddf80cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfd962700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 0x7fddf80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 -- 172.21.15.67:0/827860566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 msgr2=0x7fddf80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 0x7fddf80cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 -- 172.21.15.67:0/827860566 >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 msgr2=0x7fddf80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 --2- 172.21.15.67:0/827860566 >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 0x7fddf80cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 -- 172.21.15.67:0/827860566 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80ccb00 con 0x7fddf80cfeb0 2023-10-14T11:23:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfd962700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 0x7fddf80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfd161700 1 --2- 172.21.15.67:0/827860566 >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 0x7fddf80cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfe163700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80b1250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072c80 tx=0x7fddf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a1e328440b2210 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfc960700 1 -- 172.21.15.67:0/827860566 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000e070 con 0x7fddf80cfeb0 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.703+0000 7fddfc960700 1 -- 172.21.15.67:0/827860566 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000b9c0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddfc960700 1 -- 172.21.15.67:0/827860566 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000bd70 con 0x7fddf80cfeb0 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 -- 172.21.15.67:0/827860566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 msgr2=0x7fddf80b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80b1250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072c80 tx=0x7fddf000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 -- 172.21.15.67:0/827860566 shutdown_connections 2023-10-14T11:23:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80b1250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 --2- 172.21.15.67:0/827860566 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf80b0bb0 0x7fddf80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 --2- 172.21.15.67:0/827860566 >> v2:172.21.15.72:3300/0 conn(0x7fddf806b3b0 0x7fddf80cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.712 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 -- 172.21.15.67:0/827860566 >> 172.21.15.67:0/827860566 conn(0x7fddf80d04b0 msgr2=0x7fddf80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 -- 172.21.15.67:0/827860566 shutdown_connections 2023-10-14T11:23:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.704+0000 7fddffbc6700 1 -- 172.21.15.67:0/827860566 wait complete. 2023-10-14T11:23:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.705+0000 7fddffbc6700 1 Processor -- start 2023-10-14T11:23:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.705+0000 7fddffbc6700 1 -- start start 2023-10-14T11:23:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf806b3b0 0x7fddf815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf80b0bb0 0x7fddf806f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c5c00 con 0x7fddf80cfeb0 2023-10-14T11:23:38.716 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c4ff0 con 0x7fddf80b0bb0 2023-10-14T11:23:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddffbc6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c52d0 con 0x7fddf806b3b0 2023-10-14T11:23:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddfe163700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddfe163700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42592/0 (socket says 172.21.15.67:42592) 2023-10-14T11:23:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddfe163700 1 -- 172.21.15.67:0/416143530 learned_addr learned my addr 172.21.15.67:0/416143530 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.706+0000 7fddfd962700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf806b3b0 0x7fddf815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfd161700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf80b0bb0 0x7fddf806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 -- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf806b3b0 msgr2=0x7fddf815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf806b3b0 0x7fddf815e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 -- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf80b0bb0 msgr2=0x7fddf806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf80b0bb0 0x7fddf806f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 -- 172.21.15.67:0/416143530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009b30 con 0x7fddf80cfeb0 2023-10-14T11:23:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddfe163700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b370 tx=0x7fddf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00099b0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.719 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00092e0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80c55b0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf001c640 con 0x7fddf80cfeb0 2023-10-14T11:23:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.707+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80c4c50 con 0x7fddf80cfeb0 2023-10-14T11:23:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.708+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80c5db0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.720 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.708+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fddf001c7a0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.709+0000 7fddee7fc700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 0x7fdddc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.709+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddf008af30 con 0x7fddf80cfeb0 2023-10-14T11:23:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.709+0000 7fddfd962700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 0x7fdddc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.709+0000 7fddfd962700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 0x7fdddc06d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.713+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fddf80c5db0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.916+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fddf80c5db0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.916+0000 7fddee7fc700 1 -- 172.21.15.67:0/416143530 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fddf80c5db0 con 0x7fddf80cfeb0 2023-10-14T11:23:38.919 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.918+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 msgr2=0x7fdddc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.918+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 0x7fdddc06d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 msgr2=0x7fddf80adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:38.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b370 tx=0x7fddf0004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 shutdown_connections 2023-10-14T11:23:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdddc06af00 0x7fdddc06d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fddf80cfeb0 0x7fddf80adba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fddf806b3b0 0x7fddf815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 --2- 172.21.15.67:0/416143530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf80b0bb0 0x7fddf806f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 >> 172.21.15.67:0/416143530 conn(0x7fddf80d04b0 msgr2=0x7fddf80b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 shutdown_connections 2023-10-14T11:23:38.923 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:38.919+0000 7fddffbc6700 1 -- 172.21.15.67:0/416143530 wait complete. 2023-10-14T11:23:38.933 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T11:23:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.056+0000 7fd955e86700 1 Processor -- start 2023-10-14T11:23:39.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.056+0000 7fd955e86700 1 -- start start 2023-10-14T11:23:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd955e86700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd95015da60 0x7fd9500c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd955e86700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9500c5e70 con 0x7fd95006af90 2023-10-14T11:23:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd955e86700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95015de40 con 0x7fd9500c5a10 2023-10-14T11:23:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd955e86700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9501624b0 con 0x7fd95015da60 2023-10-14T11:23:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd94f7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd95015da60 0x7fd9500c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd94ffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd95006af90 0x7fd950071be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41894/0 (socket says 172.21.15.67:41894) 2023-10-14T11:23:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd94f7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd95015da60 0x7fd9500c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42596/0 (socket says 172.21.15.67:42596) 2023-10-14T11:23:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.057+0000 7fd94ffff700 1 -- 172.21.15.67:0/3178508414 learned_addr learned my addr 172.21.15.67:0/3178508414 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94f7fe700 1 -- 172.21.15.67:0/3178508414 >> v1:172.21.15.72:6789/0 conn(0x7fd9500c5a10 legacy=0x7fd95006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94f7fe700 1 -- 172.21.15.67:0/3178508414 >> v1:172.21.15.67:6789/0 conn(0x7fd95006af90 legacy=0x7fd950071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94f7fe700 1 -- 172.21.15.67:0/3178508414 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9501616f0 con 0x7fd95015da60 2023-10-14T11:23:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94f7fe700 1 --2- 172.21.15.67:0/3178508414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd95015da60 0x7fd9500c54d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd940009840 tx=0x7fd940009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2816aa7b2ff3ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94e7fc700 1 -- 172.21.15.67:0/3178508414 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940011830 con 0x7fd95015da60 2023-10-14T11:23:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94e7fc700 1 -- 172.21.15.67:0/3178508414 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940011990 con 0x7fd95015da60 2023-10-14T11:23:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.058+0000 7fd94e7fc700 1 -- 172.21.15.67:0/3178508414 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940011d20 con 0x7fd95015da60 2023-10-14T11:23:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 -- 172.21.15.67:0/3178508414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd95015da60 msgr2=0x7fd9500c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 --2- 172.21.15.67:0/3178508414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd95015da60 0x7fd9500c54d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd940009840 tx=0x7fd940009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:39.064 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 -- 172.21.15.67:0/3178508414 shutdown_connections 2023-10-14T11:23:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 --2- 172.21.15.67:0/3178508414 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd95015da60 0x7fd9500c54d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 -- 172.21.15.67:0/3178508414 >> 172.21.15.67:0/3178508414 conn(0x7fd9500d0440 msgr2=0x7fd9500d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 -- 172.21.15.67:0/3178508414 shutdown_connections 2023-10-14T11:23:39.065 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.059+0000 7fd955e86700 1 -- 172.21.15.67:0/3178508414 wait complete. 2023-10-14T11:23:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.060+0000 7fd955e86700 1 Processor -- start 2023-10-14T11:23:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.060+0000 7fd955e86700 1 -- start start 2023-10-14T11:23:39.068 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 0x7fd950157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 0x7fd9500caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95015a720 con 0x7fd9500c5a10 2023-10-14T11:23:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500b50f0 con 0x7fd95015da60 2023-10-14T11:23:39.069 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd955e86700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9500c9600 con 0x7fd95006af90 2023-10-14T11:23:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42604/0 (socket says 172.21.15.67:42604) 2023-10-14T11:23:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 -- 172.21.15.67:0/1988600416 learned_addr learned my addr 172.21.15.67:0/1988600416 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94f7fe700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 0x7fd950157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.070 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94ffff700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 0x7fd9500caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 -- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 msgr2=0x7fd950157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 0x7fd950157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 -- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 msgr2=0x7fd9500caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 0x7fd9500caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.071 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 -- 172.21.15.67:0/1988600416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400094a0 con 0x7fd9500c5a10 2023-10-14T11:23:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94ffff700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 0x7fd9500caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94f7fe700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 0x7fd950157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.061+0000 7fd94effd700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd93800c500 tx=0x7fd93800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9380052d0 con 0x7fd9500c5a10 2023-10-14T11:23:39.072 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd938005430 con 0x7fd9500c5a10 2023-10-14T11:23:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938006aa0 con 0x7fd9500c5a10 2023-10-14T11:23:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9500c98e0 con 0x7fd9500c5a10 2023-10-14T11:23:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9500c9ea0 con 0x7fd9500c5a10 2023-10-14T11:23:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.062+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95004ebb0 con 0x7fd9500c5a10 2023-10-14T11:23:39.073 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.063+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd938003680 con 0x7fd9500c5a10 2023-10-14T11:23:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.063+0000 7fd947fff700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 0x7fd93006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.063+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd938088880 con 0x7fd9500c5a10 2023-10-14T11:23:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.064+0000 7fd94f7fe700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 0x7fd93006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.064+0000 7fd94f7fe700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 0x7fd93006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9400090b0 tx=0x7fd940008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.075 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.068+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd938053930 con 0x7fd9500c5a10 2023-10-14T11:23:39.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.284+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd950071e70 con 0x7fd9500c5a10 2023-10-14T11:23:39.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.284+0000 7fd947fff700 1 -- 172.21.15.67:0/1988600416 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd938056f50 con 0x7fd9500c5a10 2023-10-14T11:23:39.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 msgr2=0x7fd93006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 0x7fd93006d3c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9400090b0 tx=0x7fd940008030 comp rx=0 tx=0).stop 2023-10-14T11:23:39.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 msgr2=0x7fd9500b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd93800c500 tx=0x7fd93800c8c0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 shutdown_connections 2023-10-14T11:23:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd95015da60 0x7fd9500caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd95006af90 0x7fd950157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd93006af00 0x7fd93006d3c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 --2- 172.21.15.67:0/1988600416 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd9500c5a10 0x7fd9500b4bb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.286+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 >> 172.21.15.67:0/1988600416 conn(0x7fd9500d0440 msgr2=0x7fd950160040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.287+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 shutdown_connections 2023-10-14T11:23:39.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.287+0000 7fd955e86700 1 -- 172.21.15.67:0/1988600416 wait complete. 2023-10-14T11:23:39.292 INFO:teuthology.orchestra.run.smithi067.stderr:listed 0 entries 2023-10-14T11:23:39.301 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-14T11:23:39.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:39.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-14T11:23:39.342 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:23:39.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:23:39.343 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T11:23:39.402 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T11:23:39.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:39.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.526+0000 7f500f890700 1 Processor -- start 2023-10-14T11:23:39.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.526+0000 7f500f890700 1 -- start start 2023-10-14T11:23:39.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500f890700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5008159000 0x7f500815c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500f890700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f50080ca1c0 0x7f50080ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500f890700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f500806e2b0 con 0x7f50081593e0 2023-10-14T11:23:39.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500f890700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080cab80 con 0x7f5008159000 2023-10-14T11:23:39.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500f890700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500806d730 con 0x7f50080ca1c0 2023-10-14T11:23:39.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5008159000 0x7f500815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5008159000 0x7f500815c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42610/0 (socket says 172.21.15.67:42610) 2023-10-14T11:23:39.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 -- 172.21.15.67:0/1592115858 learned_addr learned my addr 172.21.15.67:0/1592115858 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:39.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500de2d700 1 --2- 172.21.15.67:0/1592115858 >> v2:172.21.15.72:3300/0 conn(0x7f50080ca1c0 0x7f50080ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 -- 172.21.15.67:0/1592115858 >> v2:172.21.15.72:3300/0 conn(0x7f50080ca1c0 msgr2=0x7f50080ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:39.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 --2- 172.21.15.67:0/1592115858 >> v2:172.21.15.72:3300/0 conn(0x7f50080ca1c0 0x7f50080ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 -- 172.21.15.67:0/1592115858 >> v1:172.21.15.72:6789/0 conn(0x7f50081593e0 legacy=0x7f500806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.527+0000 7f500d62c700 1 -- 172.21.15.67:0/1592115858 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500806da10 con 0x7f5008159000 2023-10-14T11:23:39.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500d62c700 1 --2- 172.21.15.67:0/1592115858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5008159000 0x7f500815c780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f500806c2f0 tx=0x7f4ff8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3713c6c20a6d75df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f4ffffff700 1 -- 172.21.15.67:0/1592115858 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011830 con 0x7f5008159000 2023-10-14T11:23:39.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f4ffffff700 1 -- 172.21.15.67:0/1592115858 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8011990 con 0x7f5008159000 2023-10-14T11:23:39.534 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f4ffffff700 1 -- 172.21.15.67:0/1592115858 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011d20 con 0x7f5008159000 2023-10-14T11:23:39.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 -- 172.21.15.67:0/1592115858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5008159000 msgr2=0x7f500815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 --2- 172.21.15.67:0/1592115858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5008159000 0x7f500815c780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f500806c2f0 tx=0x7f4ff8009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 -- 172.21.15.67:0/1592115858 shutdown_connections 2023-10-14T11:23:39.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 --2- 172.21.15.67:0/1592115858 >> v2:172.21.15.72:3300/0 conn(0x7f50080ca1c0 0x7f50080ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.535 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 --2- 172.21.15.67:0/1592115858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5008159000 0x7f500815c780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 -- 172.21.15.67:0/1592115858 >> 172.21.15.67:0/1592115858 conn(0x7f50080b16f0 msgr2=0x7f50080b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:39.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 -- 172.21.15.67:0/1592115858 shutdown_connections 2023-10-14T11:23:39.536 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.528+0000 7f500f890700 1 -- 172.21.15.67:0/1592115858 wait complete. 2023-10-14T11:23:39.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 Processor -- start 2023-10-14T11:23:39.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 -- start start 2023-10-14T11:23:39.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.539 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5008159000 0x7f500815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50081593e0 0x7f50080c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500814cf30 con 0x7f50080ca1c0 2023-10-14T11:23:39.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c43e0 con 0x7f50081593e0 2023-10-14T11:23:39.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500f890700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080c37d0 con 0x7f5008159000 2023-10-14T11:23:39.540 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500d62c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500d62c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42616/0 (socket says 172.21.15.67:42616) 2023-10-14T11:23:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.530+0000 7f500d62c700 1 -- 172.21.15.67:0/595791992 learned_addr learned my addr 172.21.15.67:0/595791992 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500de2d700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50081593e0 0x7f50080c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500ce2b700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5008159000 0x7f500815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 -- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5008159000 msgr2=0x7f500815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5008159000 0x7f500815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 -- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50081593e0 msgr2=0x7f50080c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50081593e0 0x7f50080c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.542 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 -- 172.21.15.67:0/595791992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff8009550 con 0x7f50080ca1c0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500d62c700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000c00 tx=0x7f4ff8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8004380 con 0x7f50080ca1c0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff801f070 con 0x7f50080ca1c0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80036a0 con 0x7f50080ca1c0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080c3ab0 con 0x7f50080ca1c0 2023-10-14T11:23:39.543 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.531+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50080c4070 con 0x7f50080ca1c0 2023-10-14T11:23:39.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.532+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080c4200 con 0x7f50080ca1c0 2023-10-14T11:23:39.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.533+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ff8021030 con 0x7f50080ca1c0 2023-10-14T11:23:39.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.533+0000 7f4ffdffb700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 0x7f4fec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.533+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ff808a910 con 0x7f50080ca1c0 2023-10-14T11:23:39.544 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.533+0000 7f500ce2b700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 0x7f4fec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.534+0000 7f500ce2b700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 0x7f4fec06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f500815eb10 tx=0x7f5004009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.545 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.538+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ff80559d0 con 0x7f50080ca1c0 2023-10-14T11:23:39.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.786+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f500804ebb0 con 0x7f50080ca1c0 2023-10-14T11:23:39.788 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.786+0000 7f4ffdffb700 1 -- 172.21.15.67:0/595791992 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f4ff8058ff0 con 0x7f50080ca1c0 2023-10-14T11:23:39.789 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:39.789 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:39.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.788+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 msgr2=0x7f4fec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.788+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 0x7f4fec06d3c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f500815eb10 tx=0x7f5004009040 comp rx=0 tx=0).stop 2023-10-14T11:23:39.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.788+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 msgr2=0x7f500814c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.788+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000c00 tx=0x7f4ff8004750 comp rx=0 tx=0).stop 2023-10-14T11:23:39.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 shutdown_connections 2023-10-14T11:23:39.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50081593e0 0x7f50080c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f4fec06af00 0x7f4fec06d3c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.792 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f50080ca1c0 0x7f500814c9f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 --2- 172.21.15.67:0/595791992 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5008159000 0x7f500815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 >> 172.21.15.67:0/595791992 conn(0x7f50080b16f0 msgr2=0x7f5008071190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:39.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 shutdown_connections 2023-10-14T11:23:39.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.789+0000 7f500f890700 1 -- 172.21.15.67:0/595791992 wait complete. 2023-10-14T11:23:39.794 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:39.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:39.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.926+0000 7f15d76bc700 1 Processor -- start 2023-10-14T11:23:39.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.926+0000 7f15d76bc700 1 -- start start 2023-10-14T11:23:39.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d76bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 0x7f15d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d76bc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15d0161fe0 0x7f15d00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d76bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d006cdd0 con 0x7f15d00cfe80 2023-10-14T11:23:39.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d76bc700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d006c1c0 con 0x7f15d0161fe0 2023-10-14T11:23:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d76bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d006c4a0 con 0x7f15d015def0 2023-10-14T11:23:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15d0161fe0 0x7f15d00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f15d0161fe0 0x7f15d00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42628/0 (socket says 172.21.15.67:42628) 2023-10-14T11:23:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 -- 172.21.15.67:0/1001022973 learned_addr learned my addr 172.21.15.67:0/1001022973 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:39.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5458700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 0x7f15d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 -- 172.21.15.67:0/1001022973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 msgr2=0x7f15d006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:39.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 0x7f15d006d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 -- 172.21.15.67:0/1001022973 >> v1:172.21.15.72:6789/0 conn(0x7f15d00cfe80 legacy=0x7f15d01618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5c59700 1 -- 172.21.15.67:0/1001022973 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d006c780 con 0x7f15d0161fe0 2023-10-14T11:23:39.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.927+0000 7f15d5458700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 0x7f15d006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:39.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d5c59700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d00d0300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f02aebfb647da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15c7fff700 1 -- 172.21.15.67:0/1001022973 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c800e070 con 0x7f15d0161fe0 2023-10-14T11:23:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15c7fff700 1 -- 172.21.15.67:0/1001022973 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c800b9c0 con 0x7f15d0161fe0 2023-10-14T11:23:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15c7fff700 1 -- 172.21.15.67:0/1001022973 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c800bd70 con 0x7f15d0161fe0 2023-10-14T11:23:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 -- 172.21.15.67:0/1001022973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 msgr2=0x7f15d00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d00d0300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009e50 tx=0x7f15c800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:39.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 -- 172.21.15.67:0/1001022973 shutdown_connections 2023-10-14T11:23:39.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d00d0300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 --2- 172.21.15.67:0/1001022973 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d015def0 0x7f15d006d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 -- 172.21.15.67:0/1001022973 >> 172.21.15.67:0/1001022973 conn(0x7f15d00d1570 msgr2=0x7f15d00d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:39.937 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 -- 172.21.15.67:0/1001022973 shutdown_connections 2023-10-14T11:23:39.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.928+0000 7f15d76bc700 1 -- 172.21.15.67:0/1001022973 wait complete. 2023-10-14T11:23:39.940 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 Processor -- start 2023-10-14T11:23:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 -- start start 2023-10-14T11:23:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d00cfe80 0x7f15d01f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d015def0 0x7f15d0146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.941 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00c72f0 con 0x7f15d0161fe0 2023-10-14T11:23:39.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00b45f0 con 0x7f15d015def0 2023-10-14T11:23:39.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.930+0000 7f15d76bc700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00c6c30 con 0x7f15d00cfe80 2023-10-14T11:23:39.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5458700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d00cfe80 0x7f15d01f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42634/0 (socket says 172.21.15.67:42634) 2023-10-14T11:23:39.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 -- 172.21.15.67:0/2538230750 learned_addr learned my addr 172.21.15.67:0/2538230750 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:39.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d4c57700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d015def0 0x7f15d0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 -- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d00cfe80 msgr2=0x7f15d01f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d00cfe80 0x7f15d01f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 -- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d015def0 msgr2=0x7f15d0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d015def0 0x7f15d0146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 -- 172.21.15.67:0/2538230750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8009b30 con 0x7f15d0161fe0 2023-10-14T11:23:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d5c59700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f15d0072380 tx=0x7f15c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c80047c0 con 0x7f15d0161fe0 2023-10-14T11:23:39.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c80092e0 con 0x7f15d0161fe0 2023-10-14T11:23:39.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00c6f10 con 0x7f15d0161fe0 2023-10-14T11:23:39.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c801c660 con 0x7f15d0161fe0 2023-10-14T11:23:39.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.931+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00b48d0 con 0x7f15d0161fe0 2023-10-14T11:23:39.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.932+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00c7430 con 0x7f15d0161fe0 2023-10-14T11:23:39.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.933+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f15c801c7c0 con 0x7f15d0161fe0 2023-10-14T11:23:39.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.933+0000 7f15c5ffb700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 0x7f15b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:39.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.933+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15c808b150 con 0x7f15d0161fe0 2023-10-14T11:23:39.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.933+0000 7f15d5458700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 0x7f15b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:39.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.934+0000 7f15d5458700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 0x7f15b406d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15c00099d0 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:39.946 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:39.938+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f15d00c7430 con 0x7f15d0161fe0 2023-10-14T11:23:40.142 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.140+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d00c7430 con 0x7f15d0161fe0 2023-10-14T11:23:40.143 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.142+0000 7f15c5ffb700 1 -- 172.21.15.67:0/2538230750 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f15d00c7430 con 0x7f15d0161fe0 2023-10-14T11:23:40.144 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:40.144 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:40.146 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 msgr2=0x7f15b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.146 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 0x7f15b406d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f15c00099d0 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2023-10-14T11:23:40.146 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 msgr2=0x7f15d0146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f15d0072380 tx=0x7f15c8004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 shutdown_connections 2023-10-14T11:23:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f15b406af00 0x7f15b406d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f15d0161fe0 0x7f15d0146970 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.147 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f15d00cfe80 0x7f15d01f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 --2- 172.21.15.67:0/2538230750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15d015def0 0x7f15d0146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 >> 172.21.15.67:0/2538230750 conn(0x7f15d00d1570 msgr2=0x7f15d0070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:40.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 shutdown_connections 2023-10-14T11:23:40.148 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.144+0000 7f15d76bc700 1 -- 172.21.15.67:0/2538230750 wait complete. 2023-10-14T11:23:40.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T11:22:56.308284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T11:22:56.984564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:40.159 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.285+0000 7f70bd1eb700 1 Processor -- start 2023-10-14T11:23:40.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.285+0000 7f70bd1eb700 1 -- start start 2023-10-14T11:23:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 0x7f70b80d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70b80b6f70 0x7f70b80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80cc0e0 0x7f70b80d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80cc560 con 0x7f70b80b6f70 2023-10-14T11:23:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80d0460 con 0x7f70b815b7d0 2023-10-14T11:23:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70bd1eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b815bbb0 con 0x7f70b80cc0e0 2023-10-14T11:23:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70b80b6f70 0x7f70b80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f70b80b6f70 0x7f70b80cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42640/0 (socket says 172.21.15.67:42640) 2023-10-14T11:23:40.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 -- 172.21.15.67:0/2212192644 learned_addr learned my addr 172.21.15.67:0/2212192644 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b759e700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80cc0e0 0x7f70b80d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/2212192644 >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 0x7f70b80d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 -- 172.21.15.67:0/2212192644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80cc0e0 msgr2=0x7f70b80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80cc0e0 0x7f70b80d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 -- 172.21.15.67:0/2212192644 >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 msgr2=0x7f70b80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 --2- 172.21.15.67:0/2212192644 >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 0x7f70b80d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 -- 172.21.15.67:0/2212192644 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80cf6a0 con 0x7f70b80b6f70 2023-10-14T11:23:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/2212192644 >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 0x7f70b80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.286+0000 7f70b659c700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80b6f70 0x7f70b80cbba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f70b80cee50 tx=0x7f70a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237d9f630ae06352 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70b5d9b700 1 -- 172.21.15.67:0/2212192644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011830 con 0x7f70b80b6f70 2023-10-14T11:23:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70b5d9b700 1 -- 172.21.15.67:0/2212192644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8011990 con 0x7f70b80b6f70 2023-10-14T11:23:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70b5d9b700 1 -- 172.21.15.67:0/2212192644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011d20 con 0x7f70b80b6f70 2023-10-14T11:23:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 -- 172.21.15.67:0/2212192644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80b6f70 msgr2=0x7f70b80cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80b6f70 0x7f70b80cbba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f70b80cee50 tx=0x7f70a8009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 -- 172.21.15.67:0/2212192644 shutdown_connections 2023-10-14T11:23:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80cc0e0 0x7f70b80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/2212192644 >> v2:172.21.15.72:3300/0 conn(0x7f70b815b7d0 0x7f70b80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/2212192644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80b6f70 0x7f70b80cbba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 -- 172.21.15.67:0/2212192644 >> 172.21.15.67:0/2212192644 conn(0x7f70b80665a0 msgr2=0x7f70b8066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:40.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 -- 172.21.15.67:0/2212192644 shutdown_connections 2023-10-14T11:23:40.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.287+0000 7f70bd1eb700 1 -- 172.21.15.67:0/2212192644 wait complete. 2023-10-14T11:23:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.289+0000 7f70bd1eb700 1 Processor -- start 2023-10-14T11:23:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.289+0000 7f70bd1eb700 1 -- start start 2023-10-14T11:23:40.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80b6f70 0x7f70b80cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b815b7d0 0x7f70b80c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b806bd30 con 0x7f70b80cc0e0 2023-10-14T11:23:40.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b5a60 con 0x7f70b815b7d0 2023-10-14T11:23:40.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70bd1eb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b80b5c90 con 0x7f70b80b6f70 2023-10-14T11:23:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42644/0 (socket says 172.21.15.67:42644) 2023-10-14T11:23:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 -- 172.21.15.67:0/796284634 learned_addr learned my addr 172.21.15.67:0/796284634 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 -- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80b6f70 msgr2=0x7f70b80cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80b6f70 0x7f70b80cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.290+0000 7f70b659c700 1 -- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b815b7d0 msgr2=0x7f70b80c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f70b659c700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b815b7d0 0x7f70b80c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f70b659c700 1 -- 172.21.15.67:0/796284634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8009550 con 0x7f70b80cc0e0 2023-10-14T11:23:40.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f70b659c700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009c10 tx=0x7f70a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8004590 con 0x7f70b80cc0e0 2023-10-14T11:23:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a801e070 con 0x7f70b80cc0e0 2023-10-14T11:23:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b80b5f70 con 0x7f70b80cc0e0 2023-10-14T11:23:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a80038e0 con 0x7f70b80cc0e0 2023-10-14T11:23:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.291+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b80c95c0 con 0x7f70b80cc0e0 2023-10-14T11:23:40.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.292+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b80c97b0 con 0x7f70b80cc0e0 2023-10-14T11:23:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.292+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70a8003a40 con 0x7f70b80cc0e0 2023-10-14T11:23:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.293+0000 7f709f7fe700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 0x7f70a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.293+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a808a3d0 con 0x7f70b80cc0e0 2023-10-14T11:23:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.293+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 0x7f70a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.293+0000 7f70b6d9d700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 0x7f70a406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.297+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70a8055510 con 0x7f70b80cc0e0 2023-10-14T11:23:40.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.497+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70b806be70 con 0x7f70b80cc0e0 2023-10-14T11:23:40.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.497+0000 7f709f7fe700 1 -- 172.21.15.67:0/796284634 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70b806be70 con 0x7f70b80cc0e0 2023-10-14T11:23:40.500 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 msgr2=0x7f70a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 0x7f70a406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac008040 comp rx=0 tx=0).stop 2023-10-14T11:23:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 msgr2=0x7f70b80b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009c10 tx=0x7f70a8004750 comp rx=0 tx=0).stop 2023-10-14T11:23:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 shutdown_connections 2023-10-14T11:23:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f70b815b7d0 0x7f70b80c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f70b80b6f70 0x7f70b80cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f70a406af00 0x7f70a406d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 --2- 172.21.15.67:0/796284634 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f70b80cc0e0 0x7f70b80b5520 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 >> 172.21.15.67:0/796284634 conn(0x7f70b80665a0 msgr2=0x7f70b80b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 shutdown_connections 2023-10-14T11:23:40.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.499+0000 7f70bd1eb700 1 -- 172.21.15.67:0/796284634 wait complete. 2023-10-14T11:23:40.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T11:23:40.641 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.639+0000 7f8fd74e7700 1 Processor -- start 2023-10-14T11:23:40.642 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.639+0000 7f8fd74e7700 1 -- start start 2023-10-14T11:23:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd74e7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8fd015e7e0 0x7f8fd00cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd74e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd0161e00 0x7f8fd0154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd74e7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd00cd7d0 con 0x7f8fd00cf660 2023-10-14T11:23:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd74e7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd00ccbb0 con 0x7f8fd015e7e0 2023-10-14T11:23:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd74e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00ce350 con 0x7f8fd0161e00 2023-10-14T11:23:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd5283700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8fd015e7e0 0x7f8fd00cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd4a82700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f8fd00cf660 0x7f8fd01616f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41946/0 (socket says 172.21.15.67:41946) 2023-10-14T11:23:40.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd4a82700 1 -- 172.21.15.67:0/4230949163 learned_addr learned my addr 172.21.15.67:0/4230949163 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.640+0000 7f8fd5a84700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd0161e00 0x7f8fd0154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fc7fff700 1 -- 172.21.15.67:0/4230949163 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419255654 0 0) 0x7f8fd00cd7d0 con 0x7f8fd00cf660 2023-10-14T11:23:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fc7fff700 1 -- 172.21.15.67:0/4230949163 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fbc0035b0 con 0x7f8fd00cf660 2023-10-14T11:23:40.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fd5283700 1 -- 172.21.15.67:0/4230949163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd0161e00 msgr2=0x7f8fd0154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fd5283700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd0161e00 0x7f8fd0154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fd5283700 1 -- 172.21.15.67:0/4230949163 >> v1:172.21.15.67:6789/0 conn(0x7f8fd00cf660 legacy=0x7f8fd01616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fd5283700 1 -- 172.21.15.67:0/4230949163 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00cfb10 con 0x7f8fd015e7e0 2023-10-14T11:23:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fd5283700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd015e7e0 0x7f8fd00cf120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009840 tx=0x7f8fc0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb71adc7faccf4fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fc7fff700 1 -- 172.21.15.67:0/4230949163 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0011830 con 0x7f8fd015e7e0 2023-10-14T11:23:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fc7fff700 1 -- 172.21.15.67:0/4230949163 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc0011990 con 0x7f8fd015e7e0 2023-10-14T11:23:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.641+0000 7f8fc7fff700 1 -- 172.21.15.67:0/4230949163 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0011d20 con 0x7f8fd015e7e0 2023-10-14T11:23:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 -- 172.21.15.67:0/4230949163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd015e7e0 msgr2=0x7f8fd00cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd015e7e0 0x7f8fd00cf120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009840 tx=0x7f8fc0009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:40.648 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 -- 172.21.15.67:0/4230949163 shutdown_connections 2023-10-14T11:23:40.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd0161e00 0x7f8fd0154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/4230949163 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd015e7e0 0x7f8fd00cf120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 -- 172.21.15.67:0/4230949163 >> 172.21.15.67:0/4230949163 conn(0x7f8fd00665a0 msgr2=0x7f8fd0066980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:40.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 -- 172.21.15.67:0/4230949163 shutdown_connections 2023-10-14T11:23:40.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.642+0000 7f8fd74e7700 1 -- 172.21.15.67:0/4230949163 wait complete. 2023-10-14T11:23:40.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.643+0000 7f8fd74e7700 1 Processor -- start 2023-10-14T11:23:40.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.643+0000 7f8fd74e7700 1 -- start start 2023-10-14T11:23:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd015e7e0 0x7f8fd01f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd0161e00 0x7f8fd015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00b4710 con 0x7f8fd00cf660 2023-10-14T11:23:40.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd00cc5f0 con 0x7f8fd0161e00 2023-10-14T11:23:40.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd01f5fb0 con 0x7f8fd015e7e0 2023-10-14T11:23:40.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42658/0 (socket says 172.21.15.67:42658) 2023-10-14T11:23:40.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 -- 172.21.15.67:0/154126411 learned_addr learned my addr 172.21.15.67:0/154126411 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:40.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd4a82700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd015e7e0 0x7f8fd01f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 -- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd015e7e0 msgr2=0x7f8fd01f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd015e7e0 0x7f8fd01f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 -- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd0161e00 msgr2=0x7f8fd015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd0161e00 0x7f8fd015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 -- 172.21.15.67:0/154126411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00094a0 con 0x7f8fd00cf660 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd5283700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc00036a0 con 0x7f8fd00cf660 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc001f070 con 0x7f8fd00cf660 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd00cc310 con 0x7f8fd00cf660 2023-10-14T11:23:40.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.644+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0003a60 con 0x7f8fd00cf660 2023-10-14T11:23:40.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.645+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd00b4330 con 0x7f8fd00cf660 2023-10-14T11:23:40.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.646+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd00b4850 con 0x7f8fd00cf660 2023-10-14T11:23:40.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.646+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8fc0003bc0 con 0x7f8fd00cf660 2023-10-14T11:23:40.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.647+0000 7f8fc5ffb700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 0x7f8fb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:40.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.647+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc0021070 con 0x7f8fd00cf660 2023-10-14T11:23:40.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.647+0000 7f8fd4a82700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 0x7f8fb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:40.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.647+0000 7f8fd4a82700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 0x7f8fb406d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00cd520 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:40.658 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.651+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8fc0055e40 con 0x7f8fd00cf660 2023-10-14T11:23:40.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.854+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8fd004ebb0 con 0x7f8fd00cf660 2023-10-14T11:23:40.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.855+0000 7f8fc5ffb700 1 -- 172.21.15.67:0/154126411 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8fc002b020 con 0x7f8fd00cf660 2023-10-14T11:23:40.857 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 32 2023-10-14T11:23:40.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 msgr2=0x7f8fb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 0x7f8fb406d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00cd520 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2023-10-14T11:23:40.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 msgr2=0x7f8fd01f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:40.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0000c00 tx=0x7f8fc0004750 comp rx=0 tx=0).stop 2023-10-14T11:23:40.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 shutdown_connections 2023-10-14T11:23:40.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8fd0161e00 0x7f8fd015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8fb406af00 0x7f8fb406d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8fd00cf660 0x7f8fd01f2c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 --2- 172.21.15.67:0/154126411 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8fd015e7e0 0x7f8fd01f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:40.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 >> 172.21.15.67:0/154126411 conn(0x7f8fd00665a0 msgr2=0x7f8fd00d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:40.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 shutdown_connections 2023-10-14T11:23:40.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.857+0000 7f8fd74e7700 1 -- 172.21.15.67:0/154126411 wait complete. 2023-10-14T11:23:40.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T11:23:41.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.998+0000 7ffa79849700 1 Processor -- start 2023-10-14T11:23:41.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.998+0000 7ffa79849700 1 -- start start 2023-10-14T11:23:41.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa79849700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa7415d9e0 0x7ffa7415e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa79849700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa740d4410 0x7ffa740cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa79849700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7415ddc0 con 0x7ffa740d04e0 2023-10-14T11:23:41.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa79849700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7415eea0 con 0x7ffa7415d9e0 2023-10-14T11:23:41.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa79849700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740d0930 con 0x7ffa740d4410 2023-10-14T11:23:41.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa7415d9e0 0x7ffa7415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ffa7415d9e0 0x7ffa7415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42666/0 (socket says 172.21.15.67:42666) 2023-10-14T11:23:41.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 -- 172.21.15.67:0/678489791 learned_addr learned my addr 172.21.15.67:0/678489791 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:41.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa737fe700 1 --1- 172.21.15.67:0/678489791 >> v1:172.21.15.67:6789/0 conn(0x7ffa740d04e0 0x7ffa741614d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41964/0 (socket says 172.21.15.67:41964) 2023-10-14T11:23:41.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa727fc700 1 --2- 172.21.15.67:0/678489791 >> v2:172.21.15.72:3300/0 conn(0x7ffa740d4410 0x7ffa740cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 -- 172.21.15.67:0/678489791 >> v2:172.21.15.72:3300/0 conn(0x7ffa740d4410 msgr2=0x7ffa740cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:41.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 --2- 172.21.15.67:0/678489791 >> v2:172.21.15.72:3300/0 conn(0x7ffa740d4410 0x7ffa740cffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 -- 172.21.15.67:0/678489791 >> v1:172.21.15.67:6789/0 conn(0x7ffa740d04e0 legacy=0x7ffa741614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 -- 172.21.15.67:0/678489791 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740cf6b0 con 0x7ffa7415d9e0 2023-10-14T11:23:41.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa71ffb700 1 -- 172.21.15.67:0/678489791 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557664217 0 0) 0x7ffa7415ddc0 con 0x7ffa740d04e0 2023-10-14T11:23:41.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa72ffd700 1 --2- 172.21.15.67:0/678489791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7415d9e0 0x7ffa7415e960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa740d2ac0 tx=0x7ffa64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fdafbe3844b5bb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa71ffb700 1 -- 172.21.15.67:0/678489791 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400b870 con 0x7ffa7415d9e0 2023-10-14T11:23:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:40.999+0000 7ffa71ffb700 1 -- 172.21.15.67:0/678489791 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400b9d0 con 0x7ffa7415d9e0 2023-10-14T11:23:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa71ffb700 1 -- 172.21.15.67:0/678489791 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400bd60 con 0x7ffa7415d9e0 2023-10-14T11:23:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 -- 172.21.15.67:0/678489791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7415d9e0 msgr2=0x7ffa7415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 --2- 172.21.15.67:0/678489791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7415d9e0 0x7ffa7415e960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa740d2ac0 tx=0x7ffa64009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 -- 172.21.15.67:0/678489791 shutdown_connections 2023-10-14T11:23:41.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 --2- 172.21.15.67:0/678489791 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa7415d9e0 0x7ffa7415e960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 --2- 172.21.15.67:0/678489791 >> v2:172.21.15.72:3300/0 conn(0x7ffa740d4410 0x7ffa740cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 -- 172.21.15.67:0/678489791 >> 172.21.15.67:0/678489791 conn(0x7ffa7408af10 msgr2=0x7ffa740d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 -- 172.21.15.67:0/678489791 shutdown_connections 2023-10-14T11:23:41.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.000+0000 7ffa79849700 1 -- 172.21.15.67:0/678489791 wait complete. 2023-10-14T11:23:41.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.001+0000 7ffa79849700 1 Processor -- start 2023-10-14T11:23:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 -- start start 2023-10-14T11:23:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 0x7ffa74160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7415d9e0 0x7ffa740b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c9300 con 0x7ffa740d04e0 2023-10-14T11:23:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c95e0 con 0x7ffa7415d9e0 2023-10-14T11:23:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa79849700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c98c0 con 0x7ffa740d4410 2023-10-14T11:23:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa72ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa72ffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42672/0 (socket says 172.21.15.67:42672) 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa72ffd700 1 -- 172.21.15.67:0/717577070 learned_addr learned my addr 172.21.15.67:0/717577070 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.002+0000 7ffa727fc700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 0x7ffa74160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa737fe700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7415d9e0 0x7ffa740b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 -- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 msgr2=0x7ffa74160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 0x7ffa74160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 -- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7415d9e0 msgr2=0x7ffa740b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7415d9e0 0x7ffa740b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 -- 172.21.15.67:0/717577070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009550 con 0x7ffa740d04e0 2023-10-14T11:23:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa727fc700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 0x7ffa74160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:41.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa72ffd700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009c10 tx=0x7ffa64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004310 con 0x7ffa740d04e0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6401f070 con 0x7ffa740d04e0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740c9ba0 con 0x7ffa740d04e0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640036a0 con 0x7ffa740d04e0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.003+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa740c8ff0 con 0x7ffa740d04e0 2023-10-14T11:23:41.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.004+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7404ebb0 con 0x7ffa740d04e0 2023-10-14T11:23:41.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.004+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa64021030 con 0x7ffa740d04e0 2023-10-14T11:23:41.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.005+0000 7ffa5bfff700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 0x7ffa6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.005+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa6408aa40 con 0x7ffa740d04e0 2023-10-14T11:23:41.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.005+0000 7ffa727fc700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 0x7ffa6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.006+0000 7ffa727fc700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 0x7ffa6006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa741f6380 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.009+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa6408ce60 con 0x7ffa740d04e0 2023-10-14T11:23:41.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.208+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa740d0da0 con 0x7ffa740d04e0 2023-10-14T11:23:41.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.209+0000 7ffa5bfff700 1 -- 172.21.15.67:0/717577070 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa640150a0 con 0x7ffa740d04e0 2023-10-14T11:23:41.211 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 64 2023-10-14T11:23:41.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 msgr2=0x7ffa6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 0x7ffa6006d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa741f6380 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-10-14T11:23:41.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 msgr2=0x7ffa7414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009c10 tx=0x7ffa64004750 comp rx=0 tx=0).stop 2023-10-14T11:23:41.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 shutdown_connections 2023-10-14T11:23:41.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7415d9e0 0x7ffa740b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ffa6006af00 0x7ffa6006d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ffa740d04e0 0x7ffa7414cb00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 --2- 172.21.15.67:0/717577070 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ffa740d4410 0x7ffa74160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 >> 172.21.15.67:0/717577070 conn(0x7ffa7408af10 msgr2=0x7ffa740cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 shutdown_connections 2023-10-14T11:23:41.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.211+0000 7ffa79849700 1 -- 172.21.15.67:0/717577070 wait complete. 2023-10-14T11:23:41.226 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:41.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.348+0000 7faf23a9e700 1 Processor -- start 2023-10-14T11:23:41.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.348+0000 7faf23a9e700 1 -- start start 2023-10-14T11:23:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf23a9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf1c15da60 0x7faf1c0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf23a9e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf1c06af90 0x7faf1c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf23a9e700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c0c5e70 con 0x7faf1c0c5a10 2023-10-14T11:23:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf23a9e700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c1624b0 con 0x7faf1c06af90 2023-10-14T11:23:41.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf23a9e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c15de40 con 0x7faf1c15da60 2023-10-14T11:23:41.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7faf1c06af90 0x7faf1c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf21039700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faf1c0c5a10 0x7faf1c06a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41974/0 (socket says 172.21.15.67:41974) 2023-10-14T11:23:41.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf21039700 1 -- 172.21.15.67:0/1549503386 learned_addr learned my addr 172.21.15.67:0/1549503386 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2183a700 1 --2- 172.21.15.67:0/1549503386 >> v2:172.21.15.72:3300/0 conn(0x7faf1c15da60 0x7faf1c0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 -- 172.21.15.67:0/1549503386 >> v2:172.21.15.72:3300/0 conn(0x7faf1c15da60 msgr2=0x7faf1c0c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 --2- 172.21.15.67:0/1549503386 >> v2:172.21.15.72:3300/0 conn(0x7faf1c15da60 0x7faf1c0c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 -- 172.21.15.67:0/1549503386 >> v1:172.21.15.67:6789/0 conn(0x7faf1c0c5a10 legacy=0x7faf1c06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 -- 172.21.15.67:0/1549503386 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c1616f0 con 0x7faf1c06af90 2023-10-14T11:23:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf20838700 1 -- 172.21.15.67:0/1549503386 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389483702 0 0) 0x7faf1c0c5e70 con 0x7faf1c0c5a10 2023-10-14T11:23:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf2203b700 1 --2- 172.21.15.67:0/1549503386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c06af90 0x7faf1c071be0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faf1c068500 tx=0x7faf1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af52392dc123773 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf20838700 1 -- 172.21.15.67:0/1549503386 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1400e070 con 0x7faf1c06af90 2023-10-14T11:23:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf20838700 1 -- 172.21.15.67:0/1549503386 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1400bb20 con 0x7faf1c06af90 2023-10-14T11:23:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.349+0000 7faf20838700 1 -- 172.21.15.67:0/1549503386 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14012430 con 0x7faf1c06af90 2023-10-14T11:23:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 -- 172.21.15.67:0/1549503386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c06af90 msgr2=0x7faf1c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1549503386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c06af90 0x7faf1c071be0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faf1c068500 tx=0x7faf1400b330 comp rx=0 tx=0).stop 2023-10-14T11:23:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 -- 172.21.15.67:0/1549503386 shutdown_connections 2023-10-14T11:23:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1549503386 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c06af90 0x7faf1c071be0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1549503386 >> v2:172.21.15.72:3300/0 conn(0x7faf1c15da60 0x7faf1c0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 -- 172.21.15.67:0/1549503386 >> 172.21.15.67:0/1549503386 conn(0x7faf1c0d0440 msgr2=0x7faf1c0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 -- 172.21.15.67:0/1549503386 shutdown_connections 2023-10-14T11:23:41.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.350+0000 7faf23a9e700 1 -- 172.21.15.67:0/1549503386 wait complete. 2023-10-14T11:23:41.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.351+0000 7faf23a9e700 1 Processor -- start 2023-10-14T11:23:41.361 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.351+0000 7faf23a9e700 1 -- start start 2023-10-14T11:23:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf1c06af90 0x7faf1c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf1c0c5a10 0x7faf1c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c14e030 con 0x7faf1c15da60 2023-10-14T11:23:41.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c0cc400 con 0x7faf1c06af90 2023-10-14T11:23:41.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf23a9e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c0cc6e0 con 0x7faf1c0c5a10 2023-10-14T11:23:41.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42688/0 (socket says 172.21.15.67:42688) 2023-10-14T11:23:41.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 -- 172.21.15.67:0/1523885097 learned_addr learned my addr 172.21.15.67:0/1523885097 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:41.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2183a700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf1c06af90 0x7faf1c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf21039700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf1c0c5a10 0x7faf1c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 -- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf1c0c5a10 msgr2=0x7faf1c0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf1c0c5a10 0x7faf1c0b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 -- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf1c06af90 msgr2=0x7faf1c14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf1c06af90 0x7faf1c14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.352+0000 7faf2203b700 1 -- 172.21.15.67:0/1523885097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf14009a70 con 0x7faf1c15da60 2023-10-14T11:23:41.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf2203b700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0cdfc0 tx=0x7faf14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14012430 con 0x7faf1c15da60 2023-10-14T11:23:41.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14020070 con 0x7faf1c15da60 2023-10-14T11:23:41.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c0cc9c0 con 0x7faf1c15da60 2023-10-14T11:23:41.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14004280 con 0x7faf1c15da60 2023-10-14T11:23:41.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.353+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c0ccf80 con 0x7faf1c15da60 2023-10-14T11:23:41.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.354+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c04ebb0 con 0x7faf1c15da60 2023-10-14T11:23:41.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.354+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf140043e0 con 0x7faf1c15da60 2023-10-14T11:23:41.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.355+0000 7faf127fc700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 0x7faf0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.355+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf14022070 con 0x7faf1c15da60 2023-10-14T11:23:41.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.355+0000 7faf2183a700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 0x7faf0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.355+0000 7faf2183a700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 0x7faf0006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf18009b70 tx=0x7faf18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.359+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf14056840 con 0x7faf1c15da60 2023-10-14T11:23:41.606 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.604+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf1c1556e0 con 0x7faf1c15da60 2023-10-14T11:23:41.607 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.604+0000 7faf127fc700 1 -- 172.21.15.67:0/1523885097 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7faf14059e60 con 0x7faf1c15da60 2023-10-14T11:23:41.607 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:41.607 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:41.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 msgr2=0x7faf0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 0x7faf0006d3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf18009b70 tx=0x7faf18008040 comp rx=0 tx=0).stop 2023-10-14T11:23:41.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 msgr2=0x7faf1c0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0cdfc0 tx=0x7faf14004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 shutdown_connections 2023-10-14T11:23:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7faf0006af00 0x7faf0006d3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faf1c15da60 0x7faf1c0b0a60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf1c06af90 0x7faf1c14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 --2- 172.21.15.67:0/1523885097 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faf1c0c5a10 0x7faf1c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 >> 172.21.15.67:0/1523885097 conn(0x7faf1c0d0440 msgr2=0x7faf1c158190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 shutdown_connections 2023-10-14T11:23:41.611 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.606+0000 7faf23a9e700 1 -- 172.21.15.67:0/1523885097 wait complete. 2023-10-14T11:23:41.612 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:41.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:41.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.745+0000 7f6a32518700 1 Processor -- start 2023-10-14T11:23:41.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.745+0000 7f6a32518700 1 -- start start 2023-10-14T11:23:41.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a32518700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a2c15def0 0x7f6a2c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a32518700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 0x7f6a2c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a32518700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c06cdd0 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.750 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a32518700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c06c1c0 con 0x7f6a2c15def0 2023-10-14T11:23:41.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a32518700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c06c4a0 con 0x7f6a2c161fe0 2023-10-14T11:23:41.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6a2c15def0 0x7f6a2c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2b7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6a2c0cfe80 0x7f6a2c1618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:41986/0 (socket says 172.21.15.67:41986) 2023-10-14T11:23:41.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2b7fe700 1 -- 172.21.15.67:0/256033219 learned_addr learned my addr 172.21.15.67:0/256033219 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:41.751 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a30ab5700 1 --2- 172.21.15.67:0/256033219 >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 0x7f6a2c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2bfff700 1 -- 172.21.15.67:0/256033219 >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 msgr2=0x7f6a2c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:41.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2bfff700 1 --2- 172.21.15.67:0/256033219 >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 0x7f6a2c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2bfff700 1 -- 172.21.15.67:0/256033219 >> v1:172.21.15.67:6789/0 conn(0x7f6a2c0cfe80 legacy=0x7f6a2c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a2bfff700 1 -- 172.21.15.67:0/256033219 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c06c780 con 0x7f6a2c15def0 2023-10-14T11:23:41.752 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.746+0000 7f6a2affd700 1 -- 172.21.15.67:0/256033219 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180933836 0 0) 0x7f6a2c06cdd0 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a30ab5700 1 --2- 172.21.15.67:0/256033219 >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 0x7f6a2c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:41.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a2bfff700 1 --2- 172.21.15.67:0/256033219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c15def0 0x7f6a2c06d260 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0d22d0 tx=0x7f6a14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaaa62ab25f292f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a2affd700 1 -- 172.21.15.67:0/256033219 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14011830 con 0x7f6a2c15def0 2023-10-14T11:23:41.753 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a2affd700 1 -- 172.21.15.67:0/256033219 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14011990 con 0x7f6a2c15def0 2023-10-14T11:23:41.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a2affd700 1 -- 172.21.15.67:0/256033219 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14011d20 con 0x7f6a2c15def0 2023-10-14T11:23:41.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 -- 172.21.15.67:0/256033219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c15def0 msgr2=0x7f6a2c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 --2- 172.21.15.67:0/256033219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c15def0 0x7f6a2c06d260 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0d22d0 tx=0x7f6a14009b20 comp rx=0 tx=0).stop 2023-10-14T11:23:41.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 -- 172.21.15.67:0/256033219 shutdown_connections 2023-10-14T11:23:41.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 --2- 172.21.15.67:0/256033219 >> v2:172.21.15.72:3300/0 conn(0x7f6a2c161fe0 0x7f6a2c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 --2- 172.21.15.67:0/256033219 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c15def0 0x7f6a2c06d260 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 -- 172.21.15.67:0/256033219 >> 172.21.15.67:0/256033219 conn(0x7f6a2c0d1570 msgr2=0x7f6a2c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 -- 172.21.15.67:0/256033219 shutdown_connections 2023-10-14T11:23:41.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.747+0000 7f6a32518700 1 -- 172.21.15.67:0/256033219 wait complete. 2023-10-14T11:23:41.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.749+0000 7f6a32518700 1 Processor -- start 2023-10-14T11:23:41.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.749+0000 7f6a32518700 1 -- start start 2023-10-14T11:23:41.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.749+0000 7f6a32518700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 0x7f6a2c1e84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a2c161fe0 0x7f6a2c1e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c1e80c0 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c1e7440 con 0x7f6a2c161fe0 2023-10-14T11:23:41.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c1e7720 con 0x7f6a2c15def0 2023-10-14T11:23:41.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42698/0 (socket says 172.21.15.67:42698) 2023-10-14T11:23:41.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 -- 172.21.15.67:0/2388554400 learned_addr learned my addr 172.21.15.67:0/2388554400 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:41.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2b7fe700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 0x7f6a2c1e84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a30ab5700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a2c161fe0 0x7f6a2c1e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 -- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 msgr2=0x7f6a2c1e84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 0x7f6a2c1e84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 -- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a2c161fe0 msgr2=0x7f6a2c1e9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a2c161fe0 0x7f6a2c1e9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 -- 172.21.15.67:0/2388554400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140094a0 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2b7fe700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 0x7f6a2c1e84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a2bfff700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6a140090b0 tx=0x7f6a14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a140036a0 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1401f070 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14003a20 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c1e7a00 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.750+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c1e8a20 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.751+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c15f680 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.752+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6a14003b80 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.752+0000 7f6a28ff9700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 0x7f6a0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:41.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.752+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a14021070 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.752+0000 7f6a2b7fe700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 0x7f6a0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:41.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.753+0000 7f6a2b7fe700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 0x7f6a0c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c1e7310 tx=0x7f6a1c007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:41.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.757+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6a14056070 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.958+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a2c1e8c10 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.960+0000 7f6a28ff9700 1 -- 172.21.15.67:0/2388554400 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f6a14059690 con 0x7f6a2c0cfe80 2023-10-14T11:23:41.962 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:41.962 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:41.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 msgr2=0x7f6a0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 0x7f6a0c06d3c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c1e7310 tx=0x7f6a1c007ca0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 msgr2=0x7f6a2c159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:41.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6a140090b0 tx=0x7f6a14004750 comp rx=0 tx=0).stop 2023-10-14T11:23:41.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 shutdown_connections 2023-10-14T11:23:41.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a2c161fe0 0x7f6a2c1e9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6a0c06af00 0x7f6a0c06d3c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6a2c0cfe80 0x7f6a2c159a90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 --2- 172.21.15.67:0/2388554400 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6a2c15def0 0x7f6a2c1e84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:41.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 >> 172.21.15.67:0/2388554400 conn(0x7f6a2c0d1570 msgr2=0x7f6a2c15fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:41.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 shutdown_connections 2023-10-14T11:23:41.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:41.962+0000 7f6a32518700 1 -- 172.21.15.67:0/2388554400 wait complete. 2023-10-14T11:23:41.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T11:23:41.978 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:42.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.101+0000 7ff5ea98b700 1 Processor -- start 2023-10-14T11:23:42.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.101+0000 7ff5ea98b700 1 -- start start 2023-10-14T11:23:42.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5ea98b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e415da60 0x7ff5e40c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5ea98b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e40c5a10 0x7ff5e406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5ea98b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e40c5e70 con 0x7ff5e406adc0 2023-10-14T11:23:42.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5ea98b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e41624b0 con 0x7ff5e415da60 2023-10-14T11:23:42.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5ea98b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e415de40 con 0x7ff5e40c5a10 2023-10-14T11:23:42.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5e3fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e415da60 0x7ff5e40c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5e8f28700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7ff5e406adc0 0x7ff5e406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42002/0 (socket says 172.21.15.67:42002) 2023-10-14T11:23:42.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5e3fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7ff5e415da60 0x7ff5e40c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42706/0 (socket says 172.21.15.67:42706) 2023-10-14T11:23:42.107 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.102+0000 7ff5e8f28700 1 -- 172.21.15.67:0/2519415917 learned_addr learned my addr 172.21.15.67:0/2519415917 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e37fe700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e40c5a10 0x7ff5e406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e3fff700 1 -- 172.21.15.67:0/2519415917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e40c5a10 msgr2=0x7ff5e406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e3fff700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e40c5a10 0x7ff5e406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e3fff700 1 -- 172.21.15.67:0/2519415917 >> v1:172.21.15.67:6789/0 conn(0x7ff5e406adc0 legacy=0x7ff5e406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e3fff700 1 -- 172.21.15.67:0/2519415917 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e41616f0 con 0x7ff5e415da60 2023-10-14T11:23:42.108 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e2ffd700 1 -- 172.21.15.67:0/2519415917 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583102715 0 0) 0x7ff5e40c5e70 con 0x7ff5e406adc0 2023-10-14T11:23:42.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e3fff700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c54d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009840 tx=0x7ff5d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28cf7d6bf956d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e2ffd700 1 -- 172.21.15.67:0/2519415917 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011830 con 0x7ff5e415da60 2023-10-14T11:23:42.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e2ffd700 1 -- 172.21.15.67:0/2519415917 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4011990 con 0x7ff5e415da60 2023-10-14T11:23:42.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.103+0000 7ff5e2ffd700 1 -- 172.21.15.67:0/2519415917 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011d20 con 0x7ff5e415da60 2023-10-14T11:23:42.109 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 -- 172.21.15.67:0/2519415917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 msgr2=0x7ff5e40c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c54d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009840 tx=0x7ff5d4009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:42.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 -- 172.21.15.67:0/2519415917 shutdown_connections 2023-10-14T11:23:42.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c54d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/2519415917 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e40c5a10 0x7ff5e406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.110 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 -- 172.21.15.67:0/2519415917 >> 172.21.15.67:0/2519415917 conn(0x7ff5e40d0440 msgr2=0x7ff5e40d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:42.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 -- 172.21.15.67:0/2519415917 shutdown_connections 2023-10-14T11:23:42.111 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.104+0000 7ff5ea98b700 1 -- 172.21.15.67:0/2519415917 wait complete. 2023-10-14T11:23:42.113 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.105+0000 7ff5ea98b700 1 Processor -- start 2023-10-14T11:23:42.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.105+0000 7ff5ea98b700 1 -- start start 2023-10-14T11:23:42.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e406adc0 0x7ff5e41f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 0x7ff5e415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.114 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41f3eb0 con 0x7ff5e415da60 2023-10-14T11:23:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40c76b0 con 0x7ff5e40c5a10 2023-10-14T11:23:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5ea98b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40c7990 con 0x7ff5e406adc0 2023-10-14T11:23:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42714/0 (socket says 172.21.15.67:42714) 2023-10-14T11:23:42.115 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 -- 172.21.15.67:0/3046941795 learned_addr learned my addr 172.21.15.67:0/3046941795 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:42.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e3fff700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e406adc0 0x7ff5e41f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e37fe700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 0x7ff5e415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 -- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e406adc0 msgr2=0x7ff5e41f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e406adc0 0x7ff5e41f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.116 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 -- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 msgr2=0x7ff5e415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 0x7ff5e415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 -- 172.21.15.67:0/3046941795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40094a0 con 0x7ff5e415da60 2023-10-14T11:23:42.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e37fe700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 0x7ff5e415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:42.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.106+0000 7ff5e8f28700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cba0 tx=0x7ff5dc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.107+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00aad0 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.107+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00ac50 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.107+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e40c7c70 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.107+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0070d0 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.107+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e40c8230 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.108+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40c8450 con 0x7ff5e415da60 2023-10-14T11:23:42.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.108+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5dc007230 con 0x7ff5e415da60 2023-10-14T11:23:42.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.109+0000 7ff5e0ff9700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 0x7ff5c406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.109+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5dc0893e0 con 0x7ff5e415da60 2023-10-14T11:23:42.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.109+0000 7ff5e3fff700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 0x7ff5c406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.119 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.109+0000 7ff5e3fff700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 0x7ff5c406d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40090b0 tx=0x7ff5d4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.113+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5dc054490 con 0x7ff5e415da60 2023-10-14T11:23:42.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.357+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5e404ebb0 con 0x7ff5e415da60 2023-10-14T11:23:42.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.358+0000 7ff5e0ff9700 1 -- 172.21.15.67:0/3046941795 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff5dc057ab0 con 0x7ff5e415da60 2023-10-14T11:23:42.360 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:42.360 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:42.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 msgr2=0x7ff5c406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 0x7ff5c406d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40090b0 tx=0x7ff5d4008030 comp rx=0 tx=0).stop 2023-10-14T11:23:42.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 msgr2=0x7ff5e40c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc00cba0 tx=0x7ff5dc00ceb0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 shutdown_connections 2023-10-14T11:23:42.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7ff5c406af00 0x7ff5c406d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7ff5e415da60 0x7ff5e40c8750 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7ff5e406adc0 0x7ff5e41f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 --2- 172.21.15.67:0/3046941795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5e40c5a10 0x7ff5e415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 >> 172.21.15.67:0/3046941795 conn(0x7ff5e40d0440 msgr2=0x7ff5e4157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:42.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 shutdown_connections 2023-10-14T11:23:42.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.360+0000 7ff5ea98b700 1 -- 172.21.15.67:0/3046941795 wait complete. 2023-10-14T11:23:42.365 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:42.374 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:42.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.498+0000 7f01f5d9a700 1 Processor -- start 2023-10-14T11:23:42.500 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.498+0000 7f01f5d9a700 1 -- start start 2023-10-14T11:23:42.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01f5d9a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01f5d9a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f006adc0 0x7f01f0071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01f5d9a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f015de40 con 0x7f01f015da60 2023-10-14T11:23:42.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01f5d9a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f01624b0 con 0x7f01f006adc0 2023-10-14T11:23:42.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01f5d9a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f01616f0 con 0x7f01f00c5be0 2023-10-14T11:23:42.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01effff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f01f006adc0 0x7f01f0071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01ef7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01f015da60 0x7f01f00c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48834/0 (socket says 172.21.15.67:48834) 2023-10-14T11:23:42.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01eeffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:44992/0 (socket says 172.21.15.67:44992) 2023-10-14T11:23:42.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.499+0000 7f01ef7fe700 1 -- 172.21.15.67:0/3536459041 learned_addr learned my addr 172.21.15.67:0/3536459041 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:42.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01eeffd700 1 -- 172.21.15.67:0/3536459041 >> v2:172.21.15.72:3300/0 conn(0x7f01f006adc0 msgr2=0x7f01f0071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:42.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01eeffd700 1 --2- 172.21.15.67:0/3536459041 >> v2:172.21.15.72:3300/0 conn(0x7f01f006adc0 0x7f01f0071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01ee7fc700 1 -- 172.21.15.67:0/3536459041 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272216357 0 0) 0x7f01f015de40 con 0x7f01f015da60 2023-10-14T11:23:42.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01eeffd700 1 -- 172.21.15.67:0/3536459041 >> v1:172.21.15.72:6789/0 conn(0x7f01f015da60 legacy=0x7f01f00c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01eeffd700 1 -- 172.21.15.67:0/3536459041 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f01619d0 con 0x7f01f00c5be0 2023-10-14T11:23:42.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01eeffd700 1 --2- 172.21.15.67:0/3536459041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009840 tx=0x7f01e4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca71dfe4ca8461c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01ee7fc700 1 -- 172.21.15.67:0/3536459041 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011830 con 0x7f01f00c5be0 2023-10-14T11:23:42.506 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01ee7fc700 1 -- 172.21.15.67:0/3536459041 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4011990 con 0x7f01f00c5be0 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.500+0000 7f01ee7fc700 1 -- 172.21.15.67:0/3536459041 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011d20 con 0x7f01f00c5be0 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 -- 172.21.15.67:0/3536459041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 msgr2=0x7f01f006a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/3536459041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009840 tx=0x7f01e4009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 -- 172.21.15.67:0/3536459041 shutdown_connections 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/3536459041 >> v2:172.21.15.72:3300/0 conn(0x7f01f006adc0 0x7f01f0071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.507 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/3536459041 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f006a880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 -- 172.21.15.67:0/3536459041 >> 172.21.15.67:0/3536459041 conn(0x7f01f00d0440 msgr2=0x7f01f00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:42.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 -- 172.21.15.67:0/3536459041 shutdown_connections 2023-10-14T11:23:42.508 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.501+0000 7f01f5d9a700 1 -- 172.21.15.67:0/3536459041 wait complete. 2023-10-14T11:23:42.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.502+0000 7f01f5d9a700 1 Processor -- start 2023-10-14T11:23:42.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.502+0000 7f01f5d9a700 1 -- start start 2023-10-14T11:23:42.511 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f0160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 0x7f01f014b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00b5000 con 0x7f01f006adc0 2023-10-14T11:23:42.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00b52e0 con 0x7f01f015da60 2023-10-14T11:23:42.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01f5d9a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00b55c0 con 0x7f01f00c5be0 2023-10-14T11:23:42.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42724/0 (socket says 172.21.15.67:42724) 2023-10-14T11:23:42.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 -- 172.21.15.67:0/1750426740 learned_addr learned my addr 172.21.15.67:0/1750426740 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:42.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01effff700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 0x7f01f014b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01eeffd700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 -- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 msgr2=0x7f01f0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 -- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 msgr2=0x7f01f014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 0x7f01f014b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01ef7fe700 1 -- 172.21.15.67:0/1750426740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e40094a0 con 0x7f01f006adc0 2023-10-14T11:23:42.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.503+0000 7f01effff700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 0x7f01f014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:42.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01ef7fe700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01e00011e0 tx=0x7f01e000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0004c80 con 0x7f01f006adc0 2023-10-14T11:23:42.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0004e00 con 0x7f01f006adc0 2023-10-14T11:23:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f00b58a0 con 0x7f01f006adc0 2023-10-14T11:23:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007310 con 0x7f01f006adc0 2023-10-14T11:23:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.504+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f0160c70 con 0x7f01f006adc0 2023-10-14T11:23:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.505+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f004ebb0 con 0x7f01f006adc0 2023-10-14T11:23:42.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.505+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01e0007470 con 0x7f01f006adc0 2023-10-14T11:23:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.506+0000 7f01d7fff700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 0x7f01dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.506+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01e00893c0 con 0x7f01f006adc0 2023-10-14T11:23:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.506+0000 7f01eeffd700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 0x7f01dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.506+0000 7f01eeffd700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 0x7f01dc06d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009840 tx=0x7f01e401c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.510+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01e0054480 con 0x7f01f006adc0 2023-10-14T11:23:42.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.758+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01f00caa20 con 0x7f01f006adc0 2023-10-14T11:23:42.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.759+0000 7f01d7fff700 1 -- 172.21.15.67:0/1750426740 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f01e0057aa0 con 0x7f01f006adc0 2023-10-14T11:23:42.761 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:42.762 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/2352169667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2352169667},{"type":"v1","addr":"172.21.15.72:6835","nonce":2352169667}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6834/3922581021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":3922581021},{"type":"v1","addr":"172.21.15.67:6834","nonce":3922581021}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4261,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/1269736646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":1269736646},{"type":"v1","addr":"172.21.15.67:6835","nonce":1269736646}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:22:58.003453+0000","modified":"2023-10-14T11:23:01.034884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.72:6837/3174543054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":3174543054},{"type":"v1","addr":"172.21.15.72:6837","nonce":3174543054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T11:23:42.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 msgr2=0x7f01dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 0x7f01dc06d3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009840 tx=0x7f01e401c040 comp rx=0 tx=0).stop 2023-10-14T11:23:42.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 msgr2=0x7f01f015fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f01e00011e0 tx=0x7f01e000cae0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 shutdown_connections 2023-10-14T11:23:42.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01f015da60 0x7f01f014b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f01dc06af00 0x7f01dc06d3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f01f006adc0 0x7f01f015fbb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 --2- 172.21.15.67:0/1750426740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f01f00c5be0 0x7f01f0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 >> 172.21.15.67:0/1750426740 conn(0x7f01f00d0440 msgr2=0x7f01f006fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:42.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 shutdown_connections 2023-10-14T11:23:42.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.761+0000 7f01f5d9a700 1 -- 172.21.15.67:0/1750426740 wait complete. 2023-10-14T11:23:42.766 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 8 2023-10-14T11:23:42.777 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:42.901 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.899+0000 7f8e00c41700 1 Processor -- start 2023-10-14T11:23:42.902 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.899+0000 7f8e00c41700 1 -- start start 2023-10-14T11:23:42.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8dfc15da60 0x7f8dfc0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.904 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0c5a10 0x7f8dfc06a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc1624b0 con 0x7f8dfc15da60 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0c5e70 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.900+0000 7f8e00c41700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc15de40 con 0x7f8dfc06adc0 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8dfc15da60 0x7f8dfc0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.905 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f8dfc15da60 0x7f8dfc0c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42732/0 (socket says 172.21.15.67:42732) 2023-10-14T11:23:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 -- 172.21.15.67:0/2349427115 learned_addr learned my addr 172.21.15.67:0/2349427115 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8df9d9b700 1 --2- 172.21.15.67:0/2349427115 >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0c5a10 0x7f8dfc06a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfad9d700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 -- 172.21.15.67:0/2349427115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 msgr2=0x7f8dfc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:42.906 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 -- 172.21.15.67:0/2349427115 >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0c5a10 msgr2=0x7f8dfc06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:42.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/2349427115 >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0c5a10 0x7f8dfc06a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 -- 172.21.15.67:0/2349427115 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc1616f0 con 0x7f8dfc15da60 2023-10-14T11:23:42.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc15da60 0x7f8dfc0c54d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0afab0 tx=0x7f8dec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6fdbb36bc4e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8df959a700 1 -- 172.21.15.67:0/2349427115 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00b860 con 0x7f8dfc15da60 2023-10-14T11:23:42.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8df959a700 1 -- 172.21.15.67:0/2349427115 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec00b9c0 con 0x7f8dfc15da60 2023-10-14T11:23:42.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.901+0000 7f8df959a700 1 -- 172.21.15.67:0/2349427115 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00bd50 con 0x7f8dfc15da60 2023-10-14T11:23:42.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 -- 172.21.15.67:0/2349427115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc15da60 msgr2=0x7f8dfc0c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc15da60 0x7f8dfc0c54d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0afab0 tx=0x7f8dec009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:42.908 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 -- 172.21.15.67:0/2349427115 shutdown_connections 2023-10-14T11:23:42.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 --2- 172.21.15.67:0/2349427115 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc15da60 0x7f8dfc0c54d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 --2- 172.21.15.67:0/2349427115 >> v2:172.21.15.72:3300/0 conn(0x7f8dfc0c5a10 0x7f8dfc06a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 -- 172.21.15.67:0/2349427115 >> 172.21.15.67:0/2349427115 conn(0x7f8dfc0d0440 msgr2=0x7f8dfc0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:42.909 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 -- 172.21.15.67:0/2349427115 shutdown_connections 2023-10-14T11:23:42.910 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.902+0000 7f8e00c41700 1 -- 172.21.15.67:0/2349427115 wait complete. 2023-10-14T11:23:42.912 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.903+0000 7f8e00c41700 1 Processor -- start 2023-10-14T11:23:42.912 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.903+0000 7f8e00c41700 1 -- start start 2023-10-14T11:23:42.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc15da60 0x7f8dfc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc15fd00 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.913 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc152870 con 0x7f8dfc15da60 2023-10-14T11:23:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8e00c41700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc15f6d0 con 0x7f8dfc06adc0 2023-10-14T11:23:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42738/0 (socket says 172.21.15.67:42738) 2023-10-14T11:23:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 -- 172.21.15.67:0/1486298650 learned_addr learned my addr 172.21.15.67:0/1486298650 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:42.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8dfad9d700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc15da60 0x7f8dfc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 -- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 msgr2=0x7f8dfc152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 -- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc15da60 msgr2=0x7f8dfc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:42.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc15da60 0x7f8dfc15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.904+0000 7f8df9d9b700 1 -- 172.21.15.67:0/1486298650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec009550 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8df9d9b700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8df000d800 tx=0x7f8df000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00125f0 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0012750 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc14e000 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0012ac0 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.905+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc15ebd0 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.906+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc0744e0 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.906+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8df0012c20 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.907+0000 7f8deaffd700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 0x7f8ddc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:42.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.907+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8df00898b0 con 0x7f8dfc0c5a10 2023-10-14T11:23:42.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.907+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 0x7f8ddc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:42.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.907+0000 7f8dfa59c700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 0x7f8ddc06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8dec000c00 tx=0x7f8dec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:42.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:42.911+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8df00549f0 con 0x7f8dfc0c5a10 2023-10-14T11:23:43.117 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.115+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dfc15fe40 con 0x7f8dfc0c5a10 2023-10-14T11:23:43.118 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.116+0000 7f8deaffd700 1 -- 172.21.15.67:0/1486298650 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16445 (secure 0 0 0) 0x7f8dfc15fe40 con 0x7f8dfc0c5a10 2023-10-14T11:23:43.118 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:43.119 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:22:59.609507+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T11:22:56.308284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T11:22:56.984564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:43.120 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 msgr2=0x7f8ddc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 0x7f8ddc06d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8dec000c00 tx=0x7f8dec008030 comp rx=0 tx=0).stop 2023-10-14T11:23:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 msgr2=0x7f8dfc143d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8df000d800 tx=0x7f8df000dbc0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 shutdown_connections 2023-10-14T11:23:43.121 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8dfc15da60 0x7f8dfc15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f8dfc06adc0 0x7f8dfc152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ddc06af00 0x7f8ddc06d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 --2- 172.21.15.67:0/1486298650 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f8dfc0c5a10 0x7f8dfc143d00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 >> 172.21.15.67:0/1486298650 conn(0x7f8dfc0d0440 msgr2=0x7f8dfc0caab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:43.122 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 shutdown_connections 2023-10-14T11:23:43.123 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.118+0000 7f8e00c41700 1 -- 172.21.15.67:0/1486298650 wait complete. 2023-10-14T11:23:43.133 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T11:23:43.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.257+0000 7fdb55168700 1 Processor -- start 2023-10-14T11:23:43.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.257+0000 7fdb55168700 1 -- start start 2023-10-14T11:23:43.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb55168700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015da60 0x7fdb500c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb55168700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 0x7fdb50071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb55168700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500c5e70 con 0x7fdb500c5a10 2023-10-14T11:23:43.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb55168700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb501624b0 con 0x7fdb5015da60 2023-10-14T11:23:43.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb55168700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5015de40 con 0x7fdb5006af90 2023-10-14T11:23:43.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015da60 0x7fdb500c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fdb5015da60 0x7fdb500c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42744/0 (socket says 172.21.15.67:42744) 2023-10-14T11:23:43.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 -- 172.21.15.67:0/739984649 learned_addr learned my addr 172.21.15.67:0/739984649 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:43.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4f59e700 1 --2- 172.21.15.67:0/739984649 >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 0x7fdb50071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 -- 172.21.15.67:0/739984649 >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 msgr2=0x7fdb50071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:43.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 --2- 172.21.15.67:0/739984649 >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 0x7fdb50071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.258+0000 7fdb4ed9d700 1 -- 172.21.15.67:0/739984649 >> v1:172.21.15.72:6789/0 conn(0x7fdb500c5a10 legacy=0x7fdb5006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4ed9d700 1 -- 172.21.15.67:0/739984649 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb501616f0 con 0x7fdb5015da60 2023-10-14T11:23:43.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4f59e700 1 --2- 172.21.15.67:0/739984649 >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 0x7fdb50071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:43.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4ed9d700 1 --2- 172.21.15.67:0/739984649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015da60 0x7fdb500c54d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb500cce70 tx=0x7fdb44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2b99ae88416760 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4dd9b700 1 -- 172.21.15.67:0/739984649 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400b870 con 0x7fdb5015da60 2023-10-14T11:23:43.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4dd9b700 1 -- 172.21.15.67:0/739984649 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400b9d0 con 0x7fdb5015da60 2023-10-14T11:23:43.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb4dd9b700 1 -- 172.21.15.67:0/739984649 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400bd60 con 0x7fdb5015da60 2023-10-14T11:23:43.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 -- 172.21.15.67:0/739984649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015da60 msgr2=0x7fdb500c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 --2- 172.21.15.67:0/739984649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015da60 0x7fdb500c54d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb500cce70 tx=0x7fdb44009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 -- 172.21.15.67:0/739984649 shutdown_connections 2023-10-14T11:23:43.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 --2- 172.21.15.67:0/739984649 >> v2:172.21.15.72:3300/0 conn(0x7fdb5006af90 0x7fdb50071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 --2- 172.21.15.67:0/739984649 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb5015da60 0x7fdb500c54d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 -- 172.21.15.67:0/739984649 >> 172.21.15.67:0/739984649 conn(0x7fdb500d0440 msgr2=0x7fdb500d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:43.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 -- 172.21.15.67:0/739984649 shutdown_connections 2023-10-14T11:23:43.267 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.259+0000 7fdb55168700 1 -- 172.21.15.67:0/739984649 wait complete. 2023-10-14T11:23:43.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.261+0000 7fdb55168700 1 Processor -- start 2023-10-14T11:23:43.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.261+0000 7fdb55168700 1 -- start start 2023-10-14T11:23:43.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb5006af90 0x7fdb5015f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5015da60 0x7fdb500b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500ac920 con 0x7fdb500c5a10 2023-10-14T11:23:43.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50157660 con 0x7fdb5015da60 2023-10-14T11:23:43.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb55168700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50160550 con 0x7fdb5006af90 2023-10-14T11:23:43.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42750/0 (socket says 172.21.15.67:42750) 2023-10-14T11:23:43.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 -- 172.21.15.67:0/1799132426 learned_addr learned my addr 172.21.15.67:0/1799132426 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:43.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4ed9d700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb5006af90 0x7fdb5015f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4f59e700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5015da60 0x7fdb500b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 -- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb5006af90 msgr2=0x7fdb5015f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb5006af90 0x7fdb5015f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 -- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5015da60 msgr2=0x7fdb500b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5015da60 0x7fdb500b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 -- 172.21.15.67:0/1799132426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009550 con 0x7fdb500c5a10 2023-10-14T11:23:43.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.262+0000 7fdb4e59c700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c450 tx=0x7fdb4000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400052d0 con 0x7fdb500c5a10 2023-10-14T11:23:43.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb40005430 con 0x7fdb500c5a10 2023-10-14T11:23:43.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb50160830 con 0x7fdb500c5a10 2023-10-14T11:23:43.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400038c0 con 0x7fdb500c5a10 2023-10-14T11:23:43.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb50160df0 con 0x7fdb500c5a10 2023-10-14T11:23:43.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.263+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb500acad0 con 0x7fdb500c5a10 2023-10-14T11:23:43.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.264+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb40003a20 con 0x7fdb500c5a10 2023-10-14T11:23:43.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.264+0000 7fdb377fe700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 0x7fdb3c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.264+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb400888a0 con 0x7fdb500c5a10 2023-10-14T11:23:43.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.265+0000 7fdb4ed9d700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 0x7fdb3c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.275 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.265+0000 7fdb4ed9d700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 0x7fdb3c06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb44008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.269+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb500acad0 con 0x7fdb500c5a10 2023-10-14T11:23:43.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.518+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdb500acad0 con 0x7fdb500c5a10 2023-10-14T11:23:43.521 INFO:tasks.ceph.mon.a.smithi067.stderr:2023-10-14T11:23:43.519+0000 7f3c690fa700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T11:23:43.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.520+0000 7fdb377fe700 1 -- 172.21.15.67:0/1799132426 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdb500acad0 con 0x7fdb500c5a10 2023-10-14T11:23:43.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 msgr2=0x7fdb3c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 0x7fdb3c06d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb44008030 comp rx=0 tx=0).stop 2023-10-14T11:23:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 msgr2=0x7fdb5015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c450 tx=0x7fdb4000c760 comp rx=0 tx=0).stop 2023-10-14T11:23:43.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 shutdown_connections 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdb5015da60 0x7fdb500b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdb5006af90 0x7fdb5015f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdb3c06af00 0x7fdb3c06d3c0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb44008030 comp rx=0 tx=0).stop 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 --2- 172.21.15.67:0/1799132426 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdb500c5a10 0x7fdb5015fe50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.523+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 >> 172.21.15.67:0/1799132426 conn(0x7fdb500d0440 msgr2=0x7fdb50158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:43.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.524+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 shutdown_connections 2023-10-14T11:23:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.524+0000 7fdb55168700 1 -- 172.21.15.67:0/1799132426 wait complete. 2023-10-14T11:23:43.528 INFO:teuthology.orchestra.run.smithi067.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T11:23:43.538 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T11:23:43.565 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-14T11:23:43.666 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 Processor -- start 2023-10-14T11:23:43.667 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 -- start start 2023-10-14T11:23:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f763015aa60 0x7f76300ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f763015ae40 0x7f76300cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.669 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76300ad3c0 con 0x7f76300ccf00 2023-10-14T11:23:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300d1300 con 0x7f763015aa60 2023-10-14T11:23:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.665+0000 7f7636c50700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76300cd3b0 con 0x7f763015ae40 2023-10-14T11:23:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f763015aa60 0x7f76300ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f763015aa60 0x7f76300ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42756/0 (socket says 172.21.15.67:42756) 2023-10-14T11:23:43.670 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 -- 172.21.15.67:0/3524363317 learned_addr learned my addr 172.21.15.67:0/3524363317 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f762ffff700 1 --2- 172.21.15.67:0/3524363317 >> v2:172.21.15.72:3300/0 conn(0x7f763015ae40 0x7f76300cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 -- 172.21.15.67:0/3524363317 >> v2:172.21.15.72:3300/0 conn(0x7f763015ae40 msgr2=0x7f76300cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 --2- 172.21.15.67:0/3524363317 >> v2:172.21.15.72:3300/0 conn(0x7f763015ae40 0x7f76300cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 -- 172.21.15.67:0/3524363317 >> v1:172.21.15.72:6789/0 conn(0x7f76300ccf00 legacy=0x7f76300ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.671 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 -- 172.21.15.67:0/3524363317 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76300ce8f0 con 0x7f763015aa60 2023-10-14T11:23:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f76349ec700 1 --2- 172.21.15.67:0/3524363317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f763015aa60 0x7f76300ce3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7630072e50 tx=0x7f7624009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f454207dacf7fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f762f7fe700 1 -- 172.21.15.67:0/3524363317 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400b870 con 0x7f763015aa60 2023-10-14T11:23:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f762f7fe700 1 -- 172.21.15.67:0/3524363317 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762400b9d0 con 0x7f763015aa60 2023-10-14T11:23:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.666+0000 7f762f7fe700 1 -- 172.21.15.67:0/3524363317 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400bd60 con 0x7f763015aa60 2023-10-14T11:23:43.672 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 -- 172.21.15.67:0/3524363317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f763015aa60 msgr2=0x7f76300ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 --2- 172.21.15.67:0/3524363317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f763015aa60 0x7f76300ce3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7630072e50 tx=0x7f7624009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 -- 172.21.15.67:0/3524363317 shutdown_connections 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 --2- 172.21.15.67:0/3524363317 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f763015aa60 0x7f76300ce3b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 --2- 172.21.15.67:0/3524363317 >> v2:172.21.15.72:3300/0 conn(0x7f763015ae40 0x7f76300cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 -- 172.21.15.67:0/3524363317 >> 172.21.15.67:0/3524363317 conn(0x7f76300d04b0 msgr2=0x7f76300d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:43.673 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 -- 172.21.15.67:0/3524363317 shutdown_connections 2023-10-14T11:23:43.674 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.667+0000 7f7636c50700 1 -- 172.21.15.67:0/3524363317 wait complete. 2023-10-14T11:23:43.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.668+0000 7f7636c50700 1 Processor -- start 2023-10-14T11:23:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.669+0000 7f7636c50700 1 -- start start 2023-10-14T11:23:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f763015aa60 0x7f76300c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 0x7f7630150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.677 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76300b4390 con 0x7f76300ccf00 2023-10-14T11:23:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76300b4670 con 0x7f763015ae40 2023-10-14T11:23:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76300b4950 con 0x7f763015aa60 2023-10-14T11:23:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42762/0 (socket says 172.21.15.67:42762) 2023-10-14T11:23:43.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 -- 172.21.15.67:0/2974058213 learned_addr learned my addr 172.21.15.67:0/2974058213 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76351ed700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 0x7f7630150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f762ffff700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f763015aa60 0x7f76300c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 -- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f763015aa60 msgr2=0x7f76300c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f763015aa60 0x7f76300c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 -- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 msgr2=0x7f7630150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 0x7f7630150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 -- 172.21.15.67:0/2974058213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624009550 con 0x7f76300ccf00 2023-10-14T11:23:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76351ed700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 0x7f7630150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:43.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f76349ec700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7630070460 tx=0x7f7624004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7624004310 con 0x7f76300ccf00 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762401f070 con 0x7f76300ccf00 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76300ca2d0 con 0x7f76300ccf00 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.670+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240036a0 con 0x7f76300ccf00 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.671+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7630156c40 con 0x7f76300ccf00 2023-10-14T11:23:43.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.672+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76300b4fa0 con 0x7f76300ccf00 2023-10-14T11:23:43.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.672+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7624021030 con 0x7f76300ccf00 2023-10-14T11:23:43.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.672+0000 7f762d7fa700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 0x7f761406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:43.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.672+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f762408a6e0 con 0x7f76300ccf00 2023-10-14T11:23:43.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.672+0000 7f762ffff700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 0x7f761406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:43.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.673+0000 7f762ffff700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 0x7f761406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7630159920 tx=0x7f761c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:43.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.677+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f76240557c0 con 0x7f76300ccf00 2023-10-14T11:23:43.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:43.927+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7630156c40 con 0x7f76300ccf00 2023-10-14T11:23:44.523 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.522+0000 7f762d7fa700 1 -- 172.21.15.67:0/2974058213 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7630156c40 con 0x7f76300ccf00 2023-10-14T11:23:44.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 msgr2=0x7f761406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 0x7f761406d3c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7630159920 tx=0x7f761c008040 comp rx=0 tx=0).stop 2023-10-14T11:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 msgr2=0x7f76300c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7630070460 tx=0x7f7624004750 comp rx=0 tx=0).stop 2023-10-14T11:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 shutdown_connections 2023-10-14T11:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f763015ae40 0x7f7630150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f761406af00 0x7f761406d3c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f76300ccf00 0x7f76300c9d90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 --2- 172.21.15.67:0/2974058213 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f763015aa60 0x7f76300c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 >> 172.21.15.67:0/2974058213 conn(0x7f76300d04b0 msgr2=0x7f76300aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:44.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 shutdown_connections 2023-10-14T11:23:44.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.524+0000 7f7636c50700 1 -- 172.21.15.67:0/2974058213 wait complete. 2023-10-14T11:23:44.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T11:23:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.673+0000 7f95a5080700 1 Processor -- start 2023-10-14T11:23:44.675 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.673+0000 7f95a5080700 1 -- start start 2023-10-14T11:23:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f95a5080700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00b22e0 0x7f95a015ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f95a5080700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95a00cbf70 0x7f95a006a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f95a5080700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a015f4e0 con 0x7f95a015b8f0 2023-10-14T11:23:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f95a5080700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a015fb10 con 0x7f95a00cbf70 2023-10-14T11:23:44.678 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f95a5080700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00668d0 con 0x7f95a00b22e0 2023-10-14T11:23:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95a00cbf70 0x7f95a006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f95a00cbf70 0x7f95a006a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42774/0 (socket says 172.21.15.67:42774) 2023-10-14T11:23:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 -- 172.21.15.67:0/2339655522 learned_addr learned my addr 172.21.15.67:0/2339655522 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:44.679 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959e59c700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00b22e0 0x7f95a015ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 -- 172.21.15.67:0/2339655522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00b22e0 msgr2=0x7f95a015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:44.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00b22e0 0x7f95a015ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 -- 172.21.15.67:0/2339655522 >> v1:172.21.15.72:6789/0 conn(0x7f95a015b8f0 legacy=0x7f95a00cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.674+0000 7f959f59e700 1 -- 172.21.15.67:0/2339655522 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0066bb0 con 0x7f95a00cbf70 2023-10-14T11:23:44.680 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f959f59e700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a00cbf70 0x7f95a006a810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9598009e50 tx=0x7f959800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da93c5f6cd080f18 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:44.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f959dd9b700 1 -- 172.21.15.67:0/2339655522 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800e070 con 0x7f95a00cbf70 2023-10-14T11:23:44.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f959dd9b700 1 -- 172.21.15.67:0/2339655522 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800b9c0 con 0x7f95a00cbf70 2023-10-14T11:23:44.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f959dd9b700 1 -- 172.21.15.67:0/2339655522 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800bd70 con 0x7f95a00cbf70 2023-10-14T11:23:44.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 -- 172.21.15.67:0/2339655522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a00cbf70 msgr2=0x7f95a006a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.681 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a00cbf70 0x7f95a006a810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9598009e50 tx=0x7f959800b330 comp rx=0 tx=0).stop 2023-10-14T11:23:44.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 -- 172.21.15.67:0/2339655522 shutdown_connections 2023-10-14T11:23:44.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a00cbf70 0x7f95a006a810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 --2- 172.21.15.67:0/2339655522 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00b22e0 0x7f95a015ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 -- 172.21.15.67:0/2339655522 >> 172.21.15.67:0/2339655522 conn(0x7f95a00b17c0 msgr2=0x7f95a00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:44.682 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 -- 172.21.15.67:0/2339655522 shutdown_connections 2023-10-14T11:23:44.683 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.675+0000 7f95a5080700 1 -- 172.21.15.67:0/2339655522 wait complete. 2023-10-14T11:23:44.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.677+0000 7f95a5080700 1 Processor -- start 2023-10-14T11:23:44.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.677+0000 7f95a5080700 1 -- start start 2023-10-14T11:23:44.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00b22e0 0x7f95a01f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00cbf70 0x7f95a015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00c6ed0 con 0x7f95a015b8f0 2023-10-14T11:23:44.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00c71b0 con 0x7f95a00b22e0 2023-10-14T11:23:44.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f95a5080700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00c7490 con 0x7f95a00cbf70 2023-10-14T11:23:44.686 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f959f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f959f59e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42780/0 (socket says 172.21.15.67:42780) 2023-10-14T11:23:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.678+0000 7f959f59e700 1 -- 172.21.15.67:0/4279004454 learned_addr learned my addr 172.21.15.67:0/4279004454 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959e59c700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00cbf70 0x7f95a015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959ed9d700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00b22e0 0x7f95a01f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.687 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 -- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00cbf70 msgr2=0x7f95a015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00cbf70 0x7f95a015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 -- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00b22e0 msgr2=0x7f95a01f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:44.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00b22e0 0x7f95a01f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:44.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 -- 172.21.15.67:0/4279004454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009b30 con 0x7f95a015b8f0 2023-10-14T11:23:44.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f959f59e700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95a006fe10 tx=0x7f9598004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:44.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980099b0 con 0x7f95a015b8f0 2023-10-14T11:23:44.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95980092e0 con 0x7f95a015b8f0 2023-10-14T11:23:44.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00c7770 con 0x7f95a015b8f0 2023-10-14T11:23:44.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959801c640 con 0x7f95a015b8f0 2023-10-14T11:23:44.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.679+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a015b0c0 con 0x7f95a015b8f0 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.680+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a004ebb0 con 0x7f95a015b8f0 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.681+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f959801c7a0 con 0x7f95a015b8f0 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.681+0000 7f95877fe700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.681+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f959808b360 con 0x7f95a015b8f0 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.681+0000 7f959ed9d700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:44.690 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.682+0000 7f959ed9d700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 0x7f958c06d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9594007fd0 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:44.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.686+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9598056440 con 0x7f95a015b8f0 2023-10-14T11:23:44.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:44.887+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95a00c7010 con 0x7f95a015b8f0 2023-10-14T11:23:45.789 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.787+0000 7f95877fe700 1 -- 172.21.15.67:0/4279004454 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f95a00c7010 con 0x7f95a015b8f0 2023-10-14T11:23:45.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 msgr2=0x7f958c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.793 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 0x7f958c06d3c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9594007fd0 tx=0x7f9594009040 comp rx=0 tx=0).stop 2023-10-14T11:23:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 msgr2=0x7f95a00c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f95a006fe10 tx=0x7f9598004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 shutdown_connections 2023-10-14T11:23:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f958c06af00 0x7f958c06d3c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f95a015b8f0 0x7f95a00c93e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95a00b22e0 0x7f95a01f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 --2- 172.21.15.67:0/4279004454 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f95a00cbf70 0x7f95a015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.791+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 >> 172.21.15.67:0/4279004454 conn(0x7f95a00b17c0 msgr2=0x7f95a00af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:45.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.792+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 shutdown_connections 2023-10-14T11:23:45.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.792+0000 7f95a5080700 1 -- 172.21.15.67:0/4279004454 wait complete. 2023-10-14T11:23:45.797 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_metadata' removed 2023-10-14T11:23:45.812 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T11:23:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 Processor -- start 2023-10-14T11:23:45.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 -- start start 2023-10-14T11:23:45.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bf006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00b26f0 con 0x7f7bf015de80 2023-10-14T11:23:45.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00b2410 con 0x7f7bf00665a0 2023-10-14T11:23:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.951+0000 7f7bf580a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf006ced0 con 0x7f7bf015daa0 2023-10-14T11:23:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bee7fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7bf015de80 0x7f7bf00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42080/0 (socket says 172.21.15.67:42080) 2023-10-14T11:23:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bee7fc700 1 -- 172.21.15.67:0/3284587298 learned_addr learned my addr 172.21.15.67:0/3284587298 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:45.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7beeffd700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bf006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555858476 0 0) 0x7f7bf00b26f0 con 0x7f7bf015de80 2023-10-14T11:23:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc0035b0 con 0x7f7bf015de80 2023-10-14T11:23:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 336776800 0 0) 0x7f7bdc0035b0 con 0x7f7bf015de80 2023-10-14T11:23:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 msgr2=0x7f7bf006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:45.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bf006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 >> v1:172.21.15.72:6789/0 conn(0x7f7bf00665a0 legacy=0x7f7bf006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf006d1b0 con 0x7f7bf015de80 2023-10-14T11:23:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f7bd8001670 con 0x7f7bf015de80 2023-10-14T11:23:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 >> v1:172.21.15.67:6789/0 conn(0x7f7bf015de80 legacy=0x7f7bf00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc003a30 0x7f7bdc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bdc0043e0 0x7f7bdc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bdc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf006ced0 con 0x7f7bdc0043e0 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bac0 con 0x7f7bdc003a30 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bc80 con 0x7f7bf015daa0 2023-10-14T11:23:45.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.952+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bdc0043e0 0x7f7bdc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7beeffd700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc003a30 0x7f7bdc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bef7fe700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bdc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 -- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 msgr2=0x7f7bdc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf015daa0 0x7f7bdc0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 -- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc003a30 msgr2=0x7f7bdc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc003a30 0x7f7bdc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 -- 172.21.15.67:0/3284587298 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0035b0 con 0x7f7bdc0043e0 2023-10-14T11:23:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bdc0043e0 0x7f7bdc0048b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c2f0 tx=0x7f7bdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cad24ec440a1b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800ce30 con 0x7f7bdc0043e0 2023-10-14T11:23:45.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8005960 con 0x7f7bdc0043e0 2023-10-14T11:23:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.953+0000 7f7bedffb700 1 -- 172.21.15.67:0/3284587298 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8005d10 con 0x7f7bdc0043e0 2023-10-14T11:23:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 -- 172.21.15.67:0/3284587298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bdc0043e0 msgr2=0x7f7bdc0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 --2- 172.21.15.67:0/3284587298 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bdc0043e0 0x7f7bdc0048b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c2f0 tx=0x7f7bdc005880 comp rx=0 tx=0).stop 2023-10-14T11:23:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bef7fe700 1 -- 172.21.15.67:0/3284587298 reap_dead start 2023-10-14T11:23:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 -- 172.21.15.67:0/3284587298 shutdown_connections 2023-10-14T11:23:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 -- 172.21.15.67:0/3284587298 >> 172.21.15.67:0/3284587298 conn(0x7f7bf00b17c0 msgr2=0x7f7bf00b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 -- 172.21.15.67:0/3284587298 shutdown_connections 2023-10-14T11:23:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.954+0000 7f7bf580a700 1 -- 172.21.15.67:0/3284587298 wait complete. 2023-10-14T11:23:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.955+0000 7f7bf580a700 1 Processor -- start 2023-10-14T11:23:45.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.955+0000 7f7bf580a700 1 -- start start 2023-10-14T11:23:45.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc0043e0 0x7f7bf01f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf01606d0 0x7f7bf00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0161530 con 0x7f7bf015e260 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0160c90 con 0x7f7bdc0043e0 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0160f70 con 0x7f7bf01606d0 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42798/0 (socket says 172.21.15.67:42798) 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 -- 172.21.15.67:0/1424839227 learned_addr learned my addr 172.21.15.67:0/1424839227 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:45.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bef7fe700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf01606d0 0x7f7bf00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7beeffd700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc0043e0 0x7f7bf01f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 -- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf01606d0 msgr2=0x7f7bf00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf01606d0 0x7f7bf00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 -- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc0043e0 msgr2=0x7f7bf01f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:45.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc0043e0 0x7f7bf01f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:45.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 -- 172.21.15.67:0/1424839227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0161250 con 0x7f7bf015e260 2023-10-14T11:23:45.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bee7fc700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8008fd0 tx=0x7f7bd8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:45.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8007c20 con 0x7f7bf015e260 2023-10-14T11:23:45.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8004870 con 0x7f7bf015e260 2023-10-14T11:23:45.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.956+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf00b2890 con 0x7f7bf015e260 2023-10-14T11:23:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.957+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8004c00 con 0x7f7bf015e260 2023-10-14T11:23:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.957+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf01f5e80 con 0x7f7bf015e260 2023-10-14T11:23:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.957+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf00b26f0 con 0x7f7bf015e260 2023-10-14T11:23:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.958+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bd80070d0 con 0x7f7bf015e260 2023-10-14T11:23:45.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.958+0000 7f7be7fff700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 0x7f7bd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:45.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.958+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f7bd808a900 con 0x7f7bf015e260 2023-10-14T11:23:45.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.959+0000 7f7beeffd700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 0x7f7bd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:45.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.959+0000 7f7beeffd700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 0x7f7bd006d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009b20 tx=0x7f7be8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:45.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:45.963+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bf00b26f0 con 0x7f7bf015e260 2023-10-14T11:23:46.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.164+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7bf00b26f0 con 0x7f7bf015e260 2023-10-14T11:23:46.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.792+0000 7f7be7fff700 1 -- 172.21.15.67:0/1424839227 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7bf00b26f0 con 0x7f7bf015e260 2023-10-14T11:23:46.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 msgr2=0x7f7bd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:46.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 0x7f7bd006d3c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009b20 tx=0x7f7be8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:46.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 msgr2=0x7f7bf00b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:46.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8008fd0 tx=0x7f7bd8001a00 comp rx=0 tx=0).stop 2023-10-14T11:23:46.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 shutdown_connections 2023-10-14T11:23:46.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7bf01606d0 0x7f7bf00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:46.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bdc0043e0 0x7f7bf01f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:46.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7bd006af00 0x7f7bd006d3c0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009b20 tx=0x7f7be8008040 comp rx=0 tx=0).stop 2023-10-14T11:23:46.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 --2- 172.21.15.67:0/1424839227 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7bf015e260 0x7f7bf00b4ce0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:46.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.795+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 >> 172.21.15.67:0/1424839227 conn(0x7f7bf00b17c0 msgr2=0x7f7bf009dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:46.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.796+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 shutdown_connections 2023-10-14T11:23:46.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:46.796+0000 7f7bf580a700 1 -- 172.21.15.67:0/1424839227 wait complete. 2023-10-14T11:23:46.800 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'cephfs_data' removed 2023-10-14T11:23:46.815 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T11:23:46.816 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T11:23:46.816 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T11:23:46.816 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:23:46.817 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T11:23:46.817 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T11:23:46.817 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T11:23:46.817 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:23:46.818 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T11:23:46.818 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T11:23:46.818 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T11:23:46.818 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:23:46.819 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T11:23:46.819 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T11:23:46.819 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T11:23:46.820 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:23:46.828 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T11:23:46.828 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T11:23:46.830 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T11:23:46.830 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T11:23:46.831 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T11:23:46.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T11:23:46.832 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T11:23:46.832 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T11:23:46.872 INFO:tasks.ceph.mds.a:Started 2023-10-14T11:23:46.872 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:46.874 INFO:tasks.ceph.mds.b:Started 2023-10-14T11:23:46.874 INFO:tasks.ceph.mds.c:Started 2023-10-14T11:23:46.875 INFO:tasks.ceph.mds.d:Started 2023-10-14T11:23:46.875 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:46.875 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:46.876 DEBUG:teuthology.parallel:result is None 2023-10-14T11:23:46.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T11:23:46.957 INFO:tasks.ceph.mds.a.smithi067.stdout:starting mds.a at 2023-10-14T11:23:46.957 INFO:tasks.ceph.mds.c.smithi067.stdout:starting mds.c at 2023-10-14T11:23:46.958 INFO:tasks.ceph.mds.b.smithi072.stdout:starting mds.b at 2023-10-14T11:23:46.958 INFO:tasks.ceph.mds.d.smithi072.stdout:starting mds.d at 2023-10-14T11:23:47.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.009+0000 7f475eda2700 1 Processor -- start 2023-10-14T11:23:47.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.009+0000 7f475eda2700 1 -- start start 2023-10-14T11:23:47.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475eda2700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47580b04c0 0x7f47580cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475eda2700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580cef10 con 0x7f47580ceb30 2023-10-14T11:23:47.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475eda2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47580d2090 con 0x7f47580cffe0 2023-10-14T11:23:47.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475eda2700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475815deb0 con 0x7f47580b04c0 2023-10-14T11:23:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f4757fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f47580b04c0 0x7f47580cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475cb3e700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f47580ceb30 0x7f47580cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42120/0 (socket says 172.21.15.67:42120) 2023-10-14T11:23:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f475cb3e700 1 -- 172.21.15.67:0/2618406356 learned_addr learned my addr 172.21.15.67:0/2618406356 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f4757fff700 1 -- 172.21.15.67:0/2618406356 >> v1:172.21.15.72:6789/0 conn(0x7f47580cffe0 legacy=0x7f475815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:47.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f4757fff700 1 -- 172.21.15.67:0/2618406356 >> v1:172.21.15.67:6789/0 conn(0x7f47580ceb30 legacy=0x7f47580cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f4757fff700 1 -- 172.21.15.67:0/2618406356 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580d22e0 con 0x7f47580b04c0 2023-10-14T11:23:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f47577fe700 1 -- 172.21.15.67:0/2618406356 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262310278 0 0) 0x7f47580cef10 con 0x7f47580ceb30 2023-10-14T11:23:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f4757fff700 1 --2- 172.21.15.67:0/2618406356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580b04c0 0x7f47580cfaa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4744009840 tx=0x7f4744009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7b75e68905b90e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.010+0000 7f47577fe700 1 -- 172.21.15.67:0/2618406356 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744004230 con 0x7f47580b04c0 2023-10-14T11:23:47.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f47577fe700 1 -- 172.21.15.67:0/2618406356 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4744004390 con 0x7f47580b04c0 2023-10-14T11:23:47.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f47577fe700 1 -- 172.21.15.67:0/2618406356 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47440036a0 con 0x7f47580b04c0 2023-10-14T11:23:47.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 -- 172.21.15.67:0/2618406356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580b04c0 msgr2=0x7f47580cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 --2- 172.21.15.67:0/2618406356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580b04c0 0x7f47580cfaa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4744009840 tx=0x7f4744009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:47.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 -- 172.21.15.67:0/2618406356 shutdown_connections 2023-10-14T11:23:47.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 --2- 172.21.15.67:0/2618406356 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580b04c0 0x7f47580cfaa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 -- 172.21.15.67:0/2618406356 >> 172.21.15.67:0/2618406356 conn(0x7f47580d1570 msgr2=0x7f47580d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:47.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 -- 172.21.15.67:0/2618406356 shutdown_connections 2023-10-14T11:23:47.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.011+0000 7f475eda2700 1 -- 172.21.15.67:0/2618406356 wait complete. 2023-10-14T11:23:47.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.013+0000 7f475eda2700 1 Processor -- start 2023-10-14T11:23:47.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.013+0000 7f475eda2700 1 -- start start 2023-10-14T11:23:47.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47580b04c0 0x7f4758158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 0x7f47580c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475815ecd0 con 0x7f47580ceb30 2023-10-14T11:23:47.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758160620 con 0x7f47580cffe0 2023-10-14T11:23:47.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475eda2700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475815e370 con 0x7f47580b04c0 2023-10-14T11:23:47.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42834/0 (socket says 172.21.15.67:42834) 2023-10-14T11:23:47.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 -- 172.21.15.67:0/1994632297 learned_addr learned my addr 172.21.15.67:0/1994632297 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:47.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 -- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47580b04c0 msgr2=0x7f4758158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47580b04c0 0x7f4758158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 -- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 msgr2=0x7f47580c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475d33f700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 0x7f47580c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 0x7f47580c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 -- 172.21.15.67:0/1994632297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440094a0 con 0x7f47580ceb30 2023-10-14T11:23:47.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f475d33f700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 0x7f47580c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:47.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.014+0000 7f4757fff700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47440090b0 tx=0x7f4744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.015+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744011830 con 0x7f47580ceb30 2023-10-14T11:23:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.015+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474401e070 con 0x7f47580ceb30 2023-10-14T11:23:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.015+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758158ea0 con 0x7f47580ceb30 2023-10-14T11:23:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.015+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744011bf0 con 0x7f47580ceb30 2023-10-14T11:23:47.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.015+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475815e610 con 0x7f47580ceb30 2023-10-14T11:23:47.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.016+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475804ebb0 con 0x7f47580ceb30 2023-10-14T11:23:47.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.016+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4744011d50 con 0x7f47580ceb30 2023-10-14T11:23:47.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.016+0000 7f47557fa700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 0x7f473c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.017+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f474408a5d0 con 0x7f47580ceb30 2023-10-14T11:23:47.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.017+0000 7f475cb3e700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 0x7f473c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.017+0000 7f475cb3e700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 0x7f473c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f474c0011e0 tx=0x7f474c0079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.021+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4744055a10 con 0x7f47580ceb30 2023-10-14T11:23:47.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.236+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f475815e100 con 0x7f47580ceb30 2023-10-14T11:23:47.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.810+0000 7f47557fa700 1 -- 172.21.15.67:0/1994632297 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4744020080 con 0x7f47580ceb30 2023-10-14T11:23:47.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 msgr2=0x7f473c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 0x7f473c06d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f474c0011e0 tx=0x7f474c0079b0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 msgr2=0x7f47580c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47440090b0 tx=0x7f4744004750 comp rx=0 tx=0).stop 2023-10-14T11:23:47.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 shutdown_connections 2023-10-14T11:23:47.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f47580cffe0 0x7f47580c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f47580b04c0 0x7f4758158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f473c06af00 0x7f473c06d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 --2- 172.21.15.67:0/1994632297 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f47580ceb30 0x7f47580c6d70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 >> 172.21.15.67:0/1994632297 conn(0x7f47580d1570 msgr2=0x7f475815bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:47.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 shutdown_connections 2023-10-14T11:23:47.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.813+0000 7f475eda2700 1 -- 172.21.15.67:0/1994632297 wait complete. 2023-10-14T11:23:47.818 INFO:teuthology.orchestra.run.smithi067.stderr: removed all blocklist entries 2023-10-14T11:23:47.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T11:23:47.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.957+0000 7f22b4f2b700 1 Processor -- start 2023-10-14T11:23:47.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.957+0000 7f22b4f2b700 1 -- start start 2023-10-14T11:23:47.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22b4f2b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22b015e0c0 0x7f22b0072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22b4f2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22b00c52c0 0x7f22b00c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22b4f2b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b0072ac0 con 0x7f22b015e4a0 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22b4f2b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b00cfa80 con 0x7f22b015e0c0 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22b4f2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00cfd60 con 0x7f22b00c52c0 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22add9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f22b015e4a0 0x7f22b00cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42136/0 (socket says 172.21.15.67:42136) 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22add9b700 1 -- 172.21.15.67:0/472733203 learned_addr learned my addr 172.21.15.67:0/472733203 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22ae59c700 1 --2- 172.21.15.67:0/472733203 >> v2:172.21.15.72:3300/0 conn(0x7f22b015e0c0 0x7f22b0072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22b00c52c0 0x7f22b00c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377309238 0 0) 0x7f22b0072ac0 con 0x7f22b015e4a0 2023-10-14T11:23:47.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.958+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22980035b0 con 0x7f22b015e4a0 2023-10-14T11:23:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3483138550 0 0) 0x7f22980035b0 con 0x7f22b015e4a0 2023-10-14T11:23:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22b00c52c0 msgr2=0x7f22b00c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22b00c52c0 0x7f22b00c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 >> v2:172.21.15.72:3300/0 conn(0x7f22b015e0c0 msgr2=0x7f22b0072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:47.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 --2- 172.21.15.67:0/472733203 >> v2:172.21.15.72:3300/0 conn(0x7f22b015e0c0 0x7f22b0072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00d0040 con 0x7f22b015e4a0 2023-10-14T11:23:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f22a0001670 con 0x7f22b015e4a0 2023-10-14T11:23:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 >> v1:172.21.15.67:6789/0 conn(0x7f22b015e4a0 legacy=0x7f22b00cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298003a00 0x7f2298003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298004850 0x7f2298004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298005210 0x7f229800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00cfa80 con 0x7f2298005210 2023-10-14T11:23:47.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00cfd60 con 0x7f2298003a00 2023-10-14T11:23:47.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f229800bfa0 con 0x7f2298004850 2023-10-14T11:23:47.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f22b00c52c0 0x7f22b00c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ae59c700 1 --2- 172.21.15.67:0/472733203 >> v2:172.21.15.72:3300/0 conn(0x7f22b015e0c0 0x7f22b0072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298005210 0x7f229800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22add9b700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298004850 0x7f2298004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ae59c700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298003a00 0x7f2298003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 -- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298004850 msgr2=0x7f2298004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:47.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298004850 0x7f2298004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 -- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298003a00 msgr2=0x7f2298003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:47.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298003a00 0x7f2298003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 -- 172.21.15.67:0/472733203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980035b0 con 0x7f2298005210 2023-10-14T11:23:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22ae59c700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2298003a00 0x7f2298003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.959+0000 7f22aed9d700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298005210 0x7f229800ba10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f22a800e1f0 tx=0x7f2298005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44bbd4e402df3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800ec90 con 0x7f2298005210 2023-10-14T11:23:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a800f040 con 0x7f2298005210 2023-10-14T11:23:47.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22ad59a700 1 -- 172.21.15.67:0/472733203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8003a20 con 0x7f2298005210 2023-10-14T11:23:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 -- 172.21.15.67:0/472733203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298005210 msgr2=0x7f229800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/472733203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2298005210 0x7f229800ba10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f22a800e1f0 tx=0x7f2298005880 comp rx=0 tx=0).stop 2023-10-14T11:23:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22aed9d700 1 -- 172.21.15.67:0/472733203 reap_dead start 2023-10-14T11:23:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 -- 172.21.15.67:0/472733203 shutdown_connections 2023-10-14T11:23:47.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 -- 172.21.15.67:0/472733203 >> 172.21.15.67:0/472733203 conn(0x7f22b00d0440 msgr2=0x7f22b00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:47.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 -- 172.21.15.67:0/472733203 shutdown_connections 2023-10-14T11:23:47.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.960+0000 7f22b4f2b700 1 -- 172.21.15.67:0/472733203 wait complete. 2023-10-14T11:23:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 Processor -- start 2023-10-14T11:23:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 -- start start 2023-10-14T11:23:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298005210 0x7f22b00c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b014ddd0 0x7f22b014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00cb700 con 0x7f22b006ff30 2023-10-14T11:23:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b014e7c0 con 0x7f22b014ddd0 2023-10-14T11:23:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22b4f2b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00b63a0 con 0x7f2298005210 2023-10-14T11:23:47.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22add9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.962+0000 7f22add9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42856/0 (socket says 172.21.15.67:42856) 2023-10-14T11:23:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 -- 172.21.15.67:0/1356078197 learned_addr learned my addr 172.21.15.67:0/1356078197 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22aed9d700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b014ddd0 0x7f22b014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22ae59c700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298005210 0x7f22b00c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 -- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298005210 msgr2=0x7f22b00c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298005210 0x7f22b00c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 -- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b014ddd0 msgr2=0x7f22b014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b014ddd0 0x7f22b014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 -- 172.21.15.67:0/1356078197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00c7c10 con 0x7f22b006ff30 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22add9b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f22a0007340 tx=0x7f22a0007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0007ca0 con 0x7f22b006ff30 2023-10-14T11:23:47.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a000f8d0 con 0x7f22b006ff30 2023-10-14T11:23:47.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a000fc80 con 0x7f22b006ff30 2023-10-14T11:23:47.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b00cad60 con 0x7f22b006ff30 2023-10-14T11:23:47.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.963+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b00cb320 con 0x7f22b006ff30 2023-10-14T11:23:47.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.964+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b00b2f90 con 0x7f22b006ff30 2023-10-14T11:23:47.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.965+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22a001d360 con 0x7f22b006ff30 2023-10-14T11:23:47.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.965+0000 7f229effd700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 0x7f229006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:47.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.965+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22a0088aa0 con 0x7f22b006ff30 2023-10-14T11:23:47.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.965+0000 7f22ae59c700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 0x7f229006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:47.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.966+0000 7f22ae59c700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 0x7f229006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22a4004670 tx=0x7f22a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:47.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:47.970+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22a0053f30 con 0x7f22b006ff30 2023-10-14T11:23:48.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.256+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f22b004ebb0 con 0x7f22b006ff30 2023-10-14T11:23:48.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.256+0000 7f229effd700 1 -- 172.21.15.67:0/1356078197 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f22a001a070 con 0x7f22b006ff30 2023-10-14T11:23:48.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:48.259 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:23:48.259 INFO:teuthology.orchestra.run.smithi067.stdout: "auth_dump": [ 2023-10-14T11:23:48.260 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.260 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.a", 2023-10-14T11:23:48.260 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDeeSplJ+iiMRAABCuddxkrViq7TXTUx4/5TA==", 2023-10-14T11:23:48.260 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.260 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.261 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2023-10-14T11:23:48.261 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2023-10-14T11:23:48.261 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.261 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.261 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.262 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.262 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.b", 2023-10-14T11:23:48.262 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSplZvHzAhAApTdFkHIR7RdOMBuFrMosvQ==", 2023-10-14T11:23:48.262 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.262 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.263 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2023-10-14T11:23:48.263 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2023-10-14T11:23:48.263 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.263 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.263 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.264 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.264 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.c", 2023-10-14T11:23:48.264 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDeeSpl5DMTORAA4eD0zHQvDWvNHO4KXA6sTg==", 2023-10-14T11:23:48.264 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.264 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.265 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2023-10-14T11:23:48.265 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2023-10-14T11:23:48.265 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.265 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.265 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.266 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.266 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mds.d", 2023-10-14T11:23:48.266 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSplX32HChAA3B2RIKaKVTsN3RJz80uIUw==", 2023-10-14T11:23:48.266 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.266 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2023-10-14T11:23:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2023-10-14T11:23:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.267 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.268 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.268 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.0", 2023-10-14T11:23:48.268 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDieSplLyLTIxAALtd64wcm5Xvg7G80tgPSmA==", 2023-10-14T11:23:48.268 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.268 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.269 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.269 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.269 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.269 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.269 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.270 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.1", 2023-10-14T11:23:48.270 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDleSplgxZQJBAAEr3UWT0oNEFhC8oEx9fsUw==", 2023-10-14T11:23:48.270 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.270 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.270 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.271 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.271 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.271 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.271 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.271 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.2", 2023-10-14T11:23:48.272 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDoeSpl4p5VJBAAA0rg6KpUg6T5swksDIn/iA==", 2023-10-14T11:23:48.272 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.272 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.272 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.272 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.273 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.273 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.273 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.273 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.3", 2023-10-14T11:23:48.273 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDreSplnDhHJBAAtOPRyhPw7qn3foE+Ub5Kzg==", 2023-10-14T11:23:48.274 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.274 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.274 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.274 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.274 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.275 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.275 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.275 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.4", 2023-10-14T11:23:48.275 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDxeSpl8zGJKhAAV1ydfxZw1ujqv9PsNDttZQ==", 2023-10-14T11:23:48.275 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.276 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.276 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.276 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.276 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.277 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.277 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.277 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.5", 2023-10-14T11:23:48.277 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQD0eSplyFfJKhAAmPvyNlqP3KDJKCVnHEd9Cw==", 2023-10-14T11:23:48.277 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.278 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.278 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.278 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.278 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.278 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.279 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.279 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.6", 2023-10-14T11:23:48.279 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQD3eSpludAsKhAAhDFPElXDSx4mmNAo/qHPQg==", 2023-10-14T11:23:48.279 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.279 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.280 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "osd.7", 2023-10-14T11:23:48.281 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQD6eSpl/3s8KhAAF40m9fPo9NERpxOh8hoAog==", 2023-10-14T11:23:48.281 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.281 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow profile osd", 2023-10-14T11:23:48.281 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile osd", 2023-10-14T11:23:48.281 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.282 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.282 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.282 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.282 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.0", 2023-10-14T11:23:48.282 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSpl8t3yDhAAAGu18U/fwYpuJy9KZfW1kg==", 2023-10-14T11:23:48.283 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.283 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.283 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2023-10-14T11:23:48.283 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2023-10-14T11:23:48.283 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.1", 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSplOTzKFRAAJPIpBhDluCFDXp20fsl3Zg==", 2023-10-14T11:23:48.284 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.285 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.285 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2023-10-14T11:23:48.285 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2023-10-14T11:23:48.285 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2023-10-14T11:23:48.285 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.286 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.286 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.286 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.2", 2023-10-14T11:23:48.286 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSplWwpdEhAA9qPy8pk4jnXaskyacPUEtw==", 2023-10-14T11:23:48.286 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.287 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.287 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2023-10-14T11:23:48.287 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2023-10-14T11:23:48.287 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2023-10-14T11:23:48.287 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.3", 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDfeSpljU0HGRAAWXxjMfTTvVWCGSKFM2eopQ==", 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.288 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow", 2023-10-14T11:23:48.289 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow r", 2023-10-14T11:23:48.289 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow rw", 2023-10-14T11:23:48.289 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow rwx" 2023-10-14T11:23:48.289 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.289 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.290 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.290 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.admin", 2023-10-14T11:23:48.290 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDeeSplUCz2ARAAVySt+1qmB1N3IQX48KBuZg==", 2023-10-14T11:23:48.290 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.290 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2023-10-14T11:23:48.291 INFO:teuthology.orchestra.run.smithi067.stdout: "mgr": "allow *", 2023-10-14T11:23:48.291 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow *", 2023-10-14T11:23:48.291 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.291 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.291 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.292 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.292 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mds", 2023-10-14T11:23:48.292 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeipl3OImKhAA31asUeQC/d35lc3EjwhpyQ==", 2023-10-14T11:23:48.292 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.292 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T11:23:48.293 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.293 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.293 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.293 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T11:23:48.293 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeipl+ewmKhAAPhr+Y05efARYO5i9fyKfZQ==", 2023-10-14T11:23:48.294 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.294 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T11:23:48.294 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.294 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.294 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.295 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-osd", 2023-10-14T11:23:48.295 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeiplGfcmKhAAARMl21Ht1/mv5PhMcVh/dA==", 2023-10-14T11:23:48.295 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.295 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T11:23:48.295 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeiplE/8mKhAAS+D49C7tG3kWctrK0l4LOg==", 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.296 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T11:23:48.297 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.297 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.297 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.297 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T11:23:48.297 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeiplbgcnKhAA9ZwkzJAwt2AlFptkAi1GmQ==", 2023-10-14T11:23:48.298 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.298 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T11:23:48.298 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.298 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.298 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.299 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T11:23:48.299 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQAAeiploA8nKhAAQu0hwTgPxJQHIwheS7+Ubg==", 2023-10-14T11:23:48.299 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.299 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T11:23:48.299 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.300 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.300 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.300 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.x", 2023-10-14T11:23:48.300 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDeeSplq1TzLRAAlo+jQiPBkb9vMq5iivKtyA==", 2023-10-14T11:23:48.300 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2023-10-14T11:23:48.301 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:48.302 INFO:teuthology.orchestra.run.smithi067.stdout: "entity": "mgr.y", 2023-10-14T11:23:48.302 INFO:teuthology.orchestra.run.smithi067.stdout: "key": "AQDeeSpl8z2DIBAAvDZwfCoCbv6ynbRGQ1ByCQ==", 2023-10-14T11:23:48.302 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": { 2023-10-14T11:23:48.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mds": "allow *", 2023-10-14T11:23:48.302 INFO:teuthology.orchestra.run.smithi067.stdout: "mon": "allow profile mgr", 2023-10-14T11:23:48.303 INFO:teuthology.orchestra.run.smithi067.stdout: "osd": "allow *" 2023-10-14T11:23:48.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.303 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:48.303 INFO:teuthology.orchestra.run.smithi067.stdout: ] 2023-10-14T11:23:48.303 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:23:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 msgr2=0x7f229006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 0x7f229006d3c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f22a4004670 tx=0x7f22a4008040 comp rx=0 tx=0).stop 2023-10-14T11:23:48.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 msgr2=0x7f22b00c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f22a0007340 tx=0x7f22a0007650 comp rx=0 tx=0).stop 2023-10-14T11:23:48.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 shutdown_connections 2023-10-14T11:23:48.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22b014ddd0 0x7f22b014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2298005210 0x7f22b00c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f229006af00 0x7f229006d3c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 --2- 172.21.15.67:0/1356078197 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f22b006ff30 0x7f22b00c5f50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 >> 172.21.15.67:0/1356078197 conn(0x7f22b00d0440 msgr2=0x7f22b00b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:48.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 shutdown_connections 2023-10-14T11:23:48.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.258+0000 7f22b4f2b700 1 -- 172.21.15.67:0/1356078197 wait complete. 2023-10-14T11:23:48.308 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T11:23:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.433+0000 7fd411868700 1 Processor -- start 2023-10-14T11:23:48.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.433+0000 7fd411868700 1 -- start start 2023-10-14T11:23:48.437 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd411868700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd40c161ee0 0x7fd40c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd411868700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd40c162340 0x7fd40c0d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd411868700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c0ce360 con 0x7fd40c1610f0 2023-10-14T11:23:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd411868700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0d00c0 con 0x7fd40c161ee0 2023-10-14T11:23:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd411868700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0d03a0 con 0x7fd40c162340 2023-10-14T11:23:48.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd40c161ee0 0x7fd40c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd40c161ee0 0x7fd40c0d1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42864/0 (socket says 172.21.15.67:42864) 2023-10-14T11:23:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 -- 172.21.15.67:0/1629902164 learned_addr learned my addr 172.21.15.67:0/1629902164 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40b7fe700 1 --2- 172.21.15.67:0/1629902164 >> v2:172.21.15.72:3300/0 conn(0x7fd40c162340 0x7fd40c0d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 -- 172.21.15.67:0/1629902164 >> v2:172.21.15.72:3300/0 conn(0x7fd40c162340 msgr2=0x7fd40c0d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:48.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/1629902164 >> v2:172.21.15.72:3300/0 conn(0x7fd40c162340 0x7fd40c0d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 -- 172.21.15.67:0/1629902164 >> v1:172.21.15.72:6789/0 conn(0x7fd40c1610f0 legacy=0x7fd40c1617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 -- 172.21.15.67:0/1629902164 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0d0680 con 0x7fd40c161ee0 2023-10-14T11:23:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/1629902164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c161ee0 0x7fd40c0d1320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0b4400 tx=0x7fd400009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d875549e1c3abe31 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd409ffb700 1 -- 172.21.15.67:0/1629902164 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400004230 con 0x7fd40c161ee0 2023-10-14T11:23:48.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd409ffb700 1 -- 172.21.15.67:0/1629902164 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400004390 con 0x7fd40c161ee0 2023-10-14T11:23:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.434+0000 7fd409ffb700 1 -- 172.21.15.67:0/1629902164 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000036a0 con 0x7fd40c161ee0 2023-10-14T11:23:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 -- 172.21.15.67:0/1629902164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c161ee0 msgr2=0x7fd40c0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 --2- 172.21.15.67:0/1629902164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c161ee0 0x7fd40c0d1320 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0b4400 tx=0x7fd400009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 -- 172.21.15.67:0/1629902164 shutdown_connections 2023-10-14T11:23:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 --2- 172.21.15.67:0/1629902164 >> v2:172.21.15.72:3300/0 conn(0x7fd40c162340 0x7fd40c0d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 --2- 172.21.15.67:0/1629902164 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c161ee0 0x7fd40c0d1320 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 -- 172.21.15.67:0/1629902164 >> 172.21.15.67:0/1629902164 conn(0x7fd40c09cab0 msgr2=0x7fd40c0d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 -- 172.21.15.67:0/1629902164 shutdown_connections 2023-10-14T11:23:48.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.435+0000 7fd411868700 1 -- 172.21.15.67:0/1629902164 wait complete. 2023-10-14T11:23:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.436+0000 7fd411868700 1 Processor -- start 2023-10-14T11:23:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.436+0000 7fd411868700 1 -- start start 2023-10-14T11:23:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 0x7fd40c15fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 0x7fd40c1603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c15e6e0 con 0x7fd40c1610f0 2023-10-14T11:23:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c15e9c0 con 0x7fd40c162340 2023-10-14T11:23:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd411868700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c15eca0 con 0x7fd40c161ee0 2023-10-14T11:23:48.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd40affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd40affd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42868/0 (socket says 172.21.15.67:42868) 2023-10-14T11:23:48.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.437+0000 7fd40affd700 1 -- 172.21.15.67:0/519626534 learned_addr learned my addr 172.21.15.67:0/519626534 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:48.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40b7fe700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 0x7fd40c1603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 0x7fd40c15fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.447 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 -- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 msgr2=0x7fd40c15fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 0x7fd40c15fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 -- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 msgr2=0x7fd40c1603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 0x7fd40c1603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 -- 172.21.15.67:0/519626534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009550 con 0x7fd40c1610f0 2023-10-14T11:23:48.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40b7fe700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 0x7fd40c1603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 0x7fd40c15fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd40affd700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00b450 tx=0x7fd3fc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0059b0 con 0x7fd40c1610f0 2023-10-14T11:23:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc005b30 con 0x7fd40c1610f0 2023-10-14T11:23:48.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c15ef80 con 0x7fd40c1610f0 2023-10-14T11:23:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc011630 con 0x7fd40c1610f0 2023-10-14T11:23:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.438+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c15f540 con 0x7fd40c1610f0 2023-10-14T11:23:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.439+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c04ebb0 con 0x7fd40c1610f0 2023-10-14T11:23:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.439+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd3fc011790 con 0x7fd40c1610f0 2023-10-14T11:23:48.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.440+0000 7fd3f3fff700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 0x7fd3f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.440+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd3fc088ab0 con 0x7fd40c1610f0 2023-10-14T11:23:48.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.440+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 0x7fd3f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.441+0000 7fd40a7fc700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 0x7fd3f806d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0a15f0 tx=0x7fd400008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.444+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3fc053eb0 con 0x7fd40c1610f0 2023-10-14T11:23:48.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.735+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd40c0d0dd0 con 0x7fd40c1610f0 2023-10-14T11:23:48.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.737+0000 7fd3f3fff700 1 -- 172.21.15.67:0/519626534 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd3fc015070 con 0x7fd40c1610f0 2023-10-14T11:23:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 msgr2=0x7fd3f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 0x7fd3f806d3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0a15f0 tx=0x7fd400008030 comp rx=0 tx=0).stop 2023-10-14T11:23:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 msgr2=0x7fd40c152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00b450 tx=0x7fd3fc00b810 comp rx=0 tx=0).stop 2023-10-14T11:23:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 shutdown_connections 2023-10-14T11:23:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd40c162340 0x7fd40c1603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3f806af00 0x7fd3f806d3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd40c1610f0 0x7fd40c152df0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 --2- 172.21.15.67:0/519626534 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd40c161ee0 0x7fd40c15fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 >> 172.21.15.67:0/519626534 conn(0x7fd40c09cab0 msgr2=0x7fd40c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.739+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 shutdown_connections 2023-10-14T11:23:48.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.740+0000 7fd411868700 1 -- 172.21.15.67:0/519626534 wait complete. 2023-10-14T11:23:48.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T11:23:48.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.880+0000 7f97bc96d700 1 Processor -- start 2023-10-14T11:23:48.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.880+0000 7f97bc96d700 1 -- start start 2023-10-14T11:23:48.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.880+0000 7f97bc96d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b815e0c0 0x7f97b8072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97bc96d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 0x7f97b80c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97bc96d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b8072ac0 con 0x7f97b815e4a0 2023-10-14T11:23:48.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97bc96d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b80cfa80 con 0x7f97b815e0c0 2023-10-14T11:23:48.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97bc96d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b80cfd60 con 0x7f97b80c52c0 2023-10-14T11:23:48.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b815e0c0 0x7f97b8072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 0x7f97b80c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97b815e4a0 0x7f97b80cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:48996/0 (socket says 172.21.15.67:48996) 2023-10-14T11:23:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 0x7f97b80c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:45154/0 (socket says 172.21.15.67:45154) 2023-10-14T11:23:48.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b5d9b700 1 -- 172.21.15.67:0/2876183874 learned_addr learned my addr 172.21.15.67:0/2876183874 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b815e0c0 0x7f97b8072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:43286/0 (socket says 172.21.15.67:43286) 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 -- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 msgr2=0x7f97b80c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 --2- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 0x7f97b80c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 -- 172.21.15.67:0/2876183874 >> v1:172.21.15.72:6789/0 conn(0x7f97b815e4a0 legacy=0x7f97b80cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b559a700 1 -- 172.21.15.67:0/2876183874 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244995331 0 0) 0x7f97b8072ac0 con 0x7f97b815e4a0 2023-10-14T11:23:48.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 -- 172.21.15.67:0/2876183874 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80d0040 con 0x7f97b815e0c0 2023-10-14T11:23:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.881+0000 7f97b659c700 1 --2- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b815e0c0 0x7f97b8072580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009840 tx=0x7f97a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4395d2a534421c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97b559a700 1 -- 172.21.15.67:0/2876183874 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011830 con 0x7f97b815e0c0 2023-10-14T11:23:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97b559a700 1 -- 172.21.15.67:0/2876183874 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8011990 con 0x7f97b815e0c0 2023-10-14T11:23:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97b559a700 1 -- 172.21.15.67:0/2876183874 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8011d20 con 0x7f97b815e0c0 2023-10-14T11:23:48.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 -- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b815e0c0 msgr2=0x7f97b8072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b815e0c0 0x7f97b8072580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009840 tx=0x7f97a8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 -- 172.21.15.67:0/2876183874 shutdown_connections 2023-10-14T11:23:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b80c52c0 0x7f97b80c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2876183874 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b815e0c0 0x7f97b8072580 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 -- 172.21.15.67:0/2876183874 >> 172.21.15.67:0/2876183874 conn(0x7f97b80d0440 msgr2=0x7f97b80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 -- 172.21.15.67:0/2876183874 shutdown_connections 2023-10-14T11:23:48.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.882+0000 7f97bc96d700 1 -- 172.21.15.67:0/2876183874 wait complete. 2023-10-14T11:23:48.892 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 Processor -- start 2023-10-14T11:23:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 -- start start 2023-10-14T11:23:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b80c52c0 0x7f97b8154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b815e0c0 0x7f97b814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.893 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b814b850 con 0x7f97b815e4a0 2023-10-14T11:23:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b814d730 con 0x7f97b80c52c0 2023-10-14T11:23:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97bc96d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b814ca60 con 0x7f97b815e0c0 2023-10-14T11:23:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.894 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97b6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42888/0 (socket says 172.21.15.67:42888) 2023-10-14T11:23:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.884+0000 7f97b6d9d700 1 -- 172.21.15.67:0/2780386183 learned_addr learned my addr 172.21.15.67:0/2780386183 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b659c700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b80c52c0 0x7f97b8154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b5d9b700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b815e0c0 0x7f97b814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.895 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 -- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b815e0c0 msgr2=0x7f97b814c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b815e0c0 0x7f97b814c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 -- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b80c52c0 msgr2=0x7f97b8154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b80c52c0 0x7f97b8154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 -- 172.21.15.67:0/2780386183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a80094a0 con 0x7f97b815e4a0 2023-10-14T11:23:48.896 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97b6d9d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97b000efc0 tx=0x7f97b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0009ea0 con 0x7f97b815e4a0 2023-10-14T11:23:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000f040 con 0x7f97b815e4a0 2023-10-14T11:23:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000ced0 con 0x7f97b815e4a0 2023-10-14T11:23:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8152990 con 0x7f97b815e4a0 2023-10-14T11:23:48.897 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.885+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b80b37e0 con 0x7f97b815e4a0 2023-10-14T11:23:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.886+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b8152b50 con 0x7f97b815e4a0 2023-10-14T11:23:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.887+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97b0014480 con 0x7f97b815e4a0 2023-10-14T11:23:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.887+0000 7f97aeffd700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 0x7f979806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.887+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f97b0089e10 con 0x7f97b815e4a0 2023-10-14T11:23:48.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.887+0000 7f97b659c700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 0x7f979806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.888+0000 7f97b659c700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 0x7f979806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97a80090b0 tx=0x7f97a8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:48.899 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:48.892+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97b008d030 con 0x7f97b815e4a0 2023-10-14T11:23:49.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.175+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f97b804ebb0 con 0x7f97b815e4a0 2023-10-14T11:23:49.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.179+0000 7f97aeffd700 1 -- 172.21.15.67:0/2780386183 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f97b0055170 con 0x7f97b815e4a0 2023-10-14T11:23:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.181+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 msgr2=0x7f979806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.181+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 0x7f979806d3c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f97a80090b0 tx=0x7f97a8008030 comp rx=0 tx=0).stop 2023-10-14T11:23:49.184 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.181+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 msgr2=0x7f97b814f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.181+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f97b000efc0 tx=0x7f97b000c3a0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 shutdown_connections 2023-10-14T11:23:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f979806af00 0x7f979806d3c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97b815e4a0 0x7f97b814f890 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.185 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b80c52c0 0x7f97b8154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 --2- 172.21.15.67:0/2780386183 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97b815e0c0 0x7f97b814c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 >> 172.21.15.67:0/2780386183 conn(0x7f97b80d0440 msgr2=0x7f97b80d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 shutdown_connections 2023-10-14T11:23:49.186 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.182+0000 7f97bc96d700 1 -- 172.21.15.67:0/2780386183 wait complete. 2023-10-14T11:23:49.196 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T11:23:49.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.319+0000 7f732f76a700 1 Processor -- start 2023-10-14T11:23:49.322 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 -- start start 2023-10-14T11:23:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f732815e0c0 0x7f7328072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f73280c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7328072ac0 con 0x7f732815e4a0 2023-10-14T11:23:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280cfa80 con 0x7f732815e0c0 2023-10-14T11:23:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732f76a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73280cfd60 con 0x7f73280c52c0 2023-10-14T11:23:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.320+0000 7f732d506700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f732815e0c0 0x7f7328072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f732815e0c0 0x7f7328072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42892/0 (socket says 172.21.15.67:42892) 2023-10-14T11:23:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 -- 172.21.15.67:0/2946088101 learned_addr learned my addr 172.21.15.67:0/2946088101 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732dd07700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f73280c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 -- 172.21.15.67:0/2946088101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 msgr2=0x7f73280c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f73280c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 -- 172.21.15.67:0/2946088101 >> v1:172.21.15.72:6789/0 conn(0x7f732815e4a0 legacy=0x7f73280cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 -- 172.21.15.67:0/2946088101 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280d0040 con 0x7f732815e0c0 2023-10-14T11:23:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f732d506700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e0c0 0x7f7328072580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73240098f0 tx=0x7f7324009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f209b33aefbfc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f731bfff700 1 -- 172.21.15.67:0/2946088101 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324011830 con 0x7f732815e0c0 2023-10-14T11:23:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f731bfff700 1 -- 172.21.15.67:0/2946088101 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324011990 con 0x7f732815e0c0 2023-10-14T11:23:49.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.321+0000 7f731bfff700 1 -- 172.21.15.67:0/2946088101 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324011d20 con 0x7f732815e0c0 2023-10-14T11:23:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 -- 172.21.15.67:0/2946088101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e0c0 msgr2=0x7f7328072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e0c0 0x7f7328072580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73240098f0 tx=0x7f7324009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 -- 172.21.15.67:0/2946088101 shutdown_connections 2023-10-14T11:23:49.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f73280c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 --2- 172.21.15.67:0/2946088101 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e0c0 0x7f7328072580 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 -- 172.21.15.67:0/2946088101 >> 172.21.15.67:0/2946088101 conn(0x7f73280d0440 msgr2=0x7f73280d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 -- 172.21.15.67:0/2946088101 shutdown_connections 2023-10-14T11:23:49.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.322+0000 7f732f76a700 1 -- 172.21.15.67:0/2946088101 wait complete. 2023-10-14T11:23:49.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.323+0000 7f732f76a700 1 Processor -- start 2023-10-14T11:23:49.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.323+0000 7f732f76a700 1 -- start start 2023-10-14T11:23:49.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f732806fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f732815e0c0 0x7f73280b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328153d40 con 0x7f732815e4a0 2023-10-14T11:23:49.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73281538b0 con 0x7f732815e0c0 2023-10-14T11:23:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732f76a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328152ca0 con 0x7f73280c52c0 2023-10-14T11:23:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42902/0 (socket says 172.21.15.67:42902) 2023-10-14T11:23:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 -- 172.21.15.67:0/3134037740 learned_addr learned my addr 172.21.15.67:0/3134037740 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:49.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732d506700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f732806fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732cd05700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f732815e0c0 0x7f73280b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 -- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 msgr2=0x7f732806fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f732806fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 -- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f732815e0c0 msgr2=0x7f73280b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.335 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f732815e0c0 0x7f73280b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 -- 172.21.15.67:0/3134037740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324009550 con 0x7f732815e4a0 2023-10-14T11:23:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.324+0000 7f732dd07700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f732000efc0 tx=0x7f732000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.325+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000cd40 con 0x7f732815e4a0 2023-10-14T11:23:49.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.325+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000f040 con 0x7f732815e4a0 2023-10-14T11:23:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.325+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200146c0 con 0x7f732815e4a0 2023-10-14T11:23:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.325+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328152f80 con 0x7f732815e4a0 2023-10-14T11:23:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.325+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7328153540 con 0x7f732815e4a0 2023-10-14T11:23:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.326+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7328153a20 con 0x7f732815e4a0 2023-10-14T11:23:49.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.326+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7320014820 con 0x7f732815e4a0 2023-10-14T11:23:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.327+0000 7f7319ffb700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 0x7f730c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.327+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7320089ec0 con 0x7f732815e4a0 2023-10-14T11:23:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.327+0000 7f732d506700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 0x7f730c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.338 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.327+0000 7f732d506700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 0x7f730c06d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7324009c40 tx=0x7f7324008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.331+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73200552c0 con 0x7f732815e4a0 2023-10-14T11:23:49.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.613+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f73280b3280 con 0x7f732815e4a0 2023-10-14T11:23:49.618 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.617+0000 7f7319ffb700 1 -- 172.21.15.67:0/3134037740 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f732000cea0 con 0x7f732815e4a0 2023-10-14T11:23:49.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 msgr2=0x7f730c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 0x7f730c06d3c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7324009c40 tx=0x7f7324008030 comp rx=0 tx=0).stop 2023-10-14T11:23:49.621 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 msgr2=0x7f73280b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f732000efc0 tx=0x7f732000c3a0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 shutdown_connections 2023-10-14T11:23:49.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f730c06af00 0x7f730c06d3c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f732815e4a0 0x7f73280b5a40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f73280c52c0 0x7f732806fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 --2- 172.21.15.67:0/3134037740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f732815e0c0 0x7f73280b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 >> 172.21.15.67:0/3134037740 conn(0x7f73280d0440 msgr2=0x7f73280af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:49.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 shutdown_connections 2023-10-14T11:23:49.623 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.619+0000 7f732f76a700 1 -- 172.21.15.67:0/3134037740 wait complete. 2023-10-14T11:23:49.633 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T11:23:49.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.757+0000 7f1b53baa700 1 Processor -- start 2023-10-14T11:23:49.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.757+0000 7f1b53baa700 1 -- start start 2023-10-14T11:23:49.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b53baa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 0x7f1b4c0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b53baa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0ce0d0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b53baa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4c0ce950 con 0x7f1b4c160f00 2023-10-14T11:23:49.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b53baa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0b4c60 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b52147700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1b4c0d3f00 0x7f1b4c0b3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42204/0 (socket says 172.21.15.67:42204) 2023-10-14T11:23:49.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b52147700 1 -- 172.21.15.67:0/968375752 learned_addr learned my addr 172.21.15.67:0/968375752 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:49.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b51145700 1 --2- 172.21.15.67:0/968375752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 0x7f1b4c0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519797342 0 0) 0x7f1b4c0ce0d0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b380035b0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062283608 0 0) 0x7f1b4c0ce950 con 0x7f1b4c160f00 2023-10-14T11:23:49.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b4c0ce0d0 con 0x7f1b4c160f00 2023-10-14T11:23:49.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133021203 0 0) 0x7f1b380035b0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.758+0000 7f1b51145700 1 -- 172.21.15.67:0/968375752 >> v1:172.21.15.72:6789/0 conn(0x7f1b4c160f00 legacy=0x7f1b4c0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b51145700 1 -- 172.21.15.67:0/968375752 >> v1:172.21.15.67:6789/0 conn(0x7f1b4c0d3f00 legacy=0x7f1b4c0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b51145700 1 -- 172.21.15.67:0/968375752 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0b4980 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b51145700 1 --2- 172.21.15.67:0/968375752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 0x7f1b4c0b2e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0098a0 tx=0x7f1b3c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cef472f0697dafcb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440019f0 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c004030 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b50944700 1 -- 172.21.15.67:0/968375752 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0043a0 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b53baa700 1 -- 172.21.15.67:0/968375752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 msgr2=0x7f1b4c0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b53baa700 1 --2- 172.21.15.67:0/968375752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 0x7f1b4c0b2e50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0098a0 tx=0x7f1b3c009bb0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b53baa700 1 -- 172.21.15.67:0/968375752 shutdown_connections 2023-10-14T11:23:49.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b53baa700 1 --2- 172.21.15.67:0/968375752 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c0cfdf0 0x7f1b4c0b2e50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.759+0000 7f1b53baa700 1 -- 172.21.15.67:0/968375752 >> 172.21.15.67:0/968375752 conn(0x7f1b4c09cad0 msgr2=0x7f1b4c0d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:49.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.760+0000 7f1b53baa700 1 -- 172.21.15.67:0/968375752 shutdown_connections 2023-10-14T11:23:49.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.760+0000 7f1b53baa700 1 -- 172.21.15.67:0/968375752 wait complete. 2023-10-14T11:23:49.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.761+0000 7f1b53baa700 1 Processor -- start 2023-10-14T11:23:49.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.761+0000 7f1b53baa700 1 -- start start 2023-10-14T11:23:49.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4c0cfdf0 0x7f1b4c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c160f00 0x7f1b4c1e7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c157ba0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c0cba90 con 0x7f1b4c0cfdf0 2023-10-14T11:23:49.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4c156300 con 0x7f1b4c160f00 2023-10-14T11:23:49.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51946700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4c0cfdf0 0x7f1b4c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42914/0 (socket says 172.21.15.67:42914) 2023-10-14T11:23:49.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 -- 172.21.15.67:0/3306618808 learned_addr learned my addr 172.21.15.67:0/3306618808 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:49.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b52147700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c160f00 0x7f1b4c1e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 -- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c160f00 msgr2=0x7f1b4c1e7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c160f00 0x7f1b4c1e7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 -- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4c0cfdf0 msgr2=0x7f1b4c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:49.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4c0cfdf0 0x7f1b4c155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:49.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 -- 172.21.15.67:0/3306618808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0094a0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b51145700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0090b0 tx=0x7f1b3c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c003e60 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c011630 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4c157340 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0119e0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.762+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c1578c0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.763+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4c04ebb0 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.764+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1b3c011b40 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.764+0000 7f1b427fc700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 0x7f1b3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:49.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.764+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1b3c08a730 con 0x7f1b4c0d3f00 2023-10-14T11:23:49.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.764+0000 7f1b51946700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 0x7f1b3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:49.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.765+0000 7f1b51946700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 0x7f1b3006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007fd0 tx=0x7f1b48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:49.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:49.769+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1b3c055bc0 con 0x7f1b4c0d3f00 2023-10-14T11:23:50.053 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.051+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f1b4c0d22d0 con 0x7f1b4c0d3f00 2023-10-14T11:23:50.057 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.055+0000 7f1b427fc700 1 -- 172.21.15.67:0/3306618808 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1b3c0591e0 con 0x7f1b4c0d3f00 2023-10-14T11:23:50.059 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 msgr2=0x7f1b3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 0x7f1b3006d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007fd0 tx=0x7f1b48009040 comp rx=0 tx=0).stop 2023-10-14T11:23:50.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 msgr2=0x7f1b4c15cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0090b0 tx=0x7f1b3c0047c0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 shutdown_connections 2023-10-14T11:23:50.060 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1b4c160f00 0x7f1b4c1e7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4c0cfdf0 0x7f1b4c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1b3006af00 0x7f1b3006d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 --2- 172.21.15.67:0/3306618808 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1b4c0d3f00 0x7f1b4c15cbf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 >> 172.21.15.67:0/3306618808 conn(0x7f1b4c09cad0 msgr2=0x7f1b4c0c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:50.061 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 shutdown_connections 2023-10-14T11:23:50.062 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.057+0000 7f1b53baa700 1 -- 172.21.15.67:0/3306618808 wait complete. 2023-10-14T11:23:50.071 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T11:23:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.196+0000 7fc27bc23700 1 Processor -- start 2023-10-14T11:23:50.198 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.196+0000 7fc27bc23700 1 -- start start 2023-10-14T11:23:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27bc23700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc27415e0c0 0x7fc274072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27bc23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2740c52c0 0x7fc2740c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27bc23700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc274072ac0 con 0x7fc27415e4a0 2023-10-14T11:23:50.201 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27bc23700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740cfa80 con 0x7fc27415e0c0 2023-10-14T11:23:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27bc23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740cfd60 con 0x7fc2740c52c0 2023-10-14T11:23:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc27415e0c0 0x7fc274072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fc27415e0c0 0x7fc274072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42920/0 (socket says 172.21.15.67:42920) 2023-10-14T11:23:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 -- 172.21.15.67:0/1149722537 learned_addr learned my addr 172.21.15.67:0/1149722537 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:50.202 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc27a1c0700 1 --2- 172.21.15.67:0/1149722537 >> v2:172.21.15.72:3300/0 conn(0x7fc2740c52c0 0x7fc2740c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 -- 172.21.15.67:0/1149722537 >> v2:172.21.15.72:3300/0 conn(0x7fc2740c52c0 msgr2=0x7fc2740c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 --2- 172.21.15.67:0/1149722537 >> v2:172.21.15.72:3300/0 conn(0x7fc2740c52c0 0x7fc2740c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 -- 172.21.15.67:0/1149722537 >> v1:172.21.15.72:6789/0 conn(0x7fc27415e4a0 legacy=0x7fc2740cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 -- 172.21.15.67:0/1149722537 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740d0040 con 0x7fc27415e0c0 2023-10-14T11:23:50.203 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2799bf700 1 --2- 172.21.15.67:0/1149722537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e0c0 0x7fc274072580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc274067660 tx=0x7fc27000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44453a0b28b7b4ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.197+0000 7fc2789bd700 1 -- 172.21.15.67:0/1149722537 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27000dcf0 con 0x7fc27415e0c0 2023-10-14T11:23:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc2789bd700 1 -- 172.21.15.67:0/1149722537 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27000de50 con 0x7fc27415e0c0 2023-10-14T11:23:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc2789bd700 1 -- 172.21.15.67:0/1149722537 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc270004250 con 0x7fc27415e0c0 2023-10-14T11:23:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 -- 172.21.15.67:0/1149722537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e0c0 msgr2=0x7fc274072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.204 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 --2- 172.21.15.67:0/1149722537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e0c0 0x7fc274072580 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc274067660 tx=0x7fc27000be70 comp rx=0 tx=0).stop 2023-10-14T11:23:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 -- 172.21.15.67:0/1149722537 shutdown_connections 2023-10-14T11:23:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 --2- 172.21.15.67:0/1149722537 >> v2:172.21.15.72:3300/0 conn(0x7fc2740c52c0 0x7fc2740c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 --2- 172.21.15.67:0/1149722537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e0c0 0x7fc274072580 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 -- 172.21.15.67:0/1149722537 >> 172.21.15.67:0/1149722537 conn(0x7fc2740d0440 msgr2=0x7fc2740d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:50.205 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 -- 172.21.15.67:0/1149722537 shutdown_connections 2023-10-14T11:23:50.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.198+0000 7fc27bc23700 1 -- 172.21.15.67:0/1149722537 wait complete. 2023-10-14T11:23:50.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.199+0000 7fc27bc23700 1 Processor -- start 2023-10-14T11:23:50.208 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.199+0000 7fc27bc23700 1 -- start start 2023-10-14T11:23:50.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2740c52c0 0x7fc2741f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc27415e0c0 0x7fc274151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741497a0 con 0x7fc27415e4a0 2023-10-14T11:23:50.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740c7510 con 0x7fc2740c52c0 2023-10-14T11:23:50.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27bc23700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27414d430 con 0x7fc27415e0c0 2023-10-14T11:23:50.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27a1c0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27a1c0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42930/0 (socket says 172.21.15.67:42930) 2023-10-14T11:23:50.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.200+0000 7fc27a1c0700 1 -- 172.21.15.67:0/2634424286 learned_addr learned my addr 172.21.15.67:0/2634424286 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:50.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc2799bf700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2740c52c0 0x7fc2741f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc2791be700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc27415e0c0 0x7fc274151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 -- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc27415e0c0 msgr2=0x7fc274151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc27415e0c0 0x7fc274151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 -- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2740c52c0 msgr2=0x7fc2741f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2740c52c0 0x7fc2741f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 -- 172.21.15.67:0/2634424286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27000b7f0 con 0x7fc27415e4a0 2023-10-14T11:23:50.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27a1c0700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007e40 tx=0x7fc26c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00eea0 con 0x7fc27415e4a0 2023-10-14T11:23:50.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c014420 con 0x7fc27415e4a0 2023-10-14T11:23:50.213 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2741f2ea0 con 0x7fc27415e4a0 2023-10-14T11:23:50.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0147b0 con 0x7fc27415e4a0 2023-10-14T11:23:50.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.201+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2740af660 con 0x7fc27415e4a0 2023-10-14T11:23:50.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.202+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27415e910 con 0x7fc27415e4a0 2023-10-14T11:23:50.214 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.202+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc26c014910 con 0x7fc27415e4a0 2023-10-14T11:23:50.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.203+0000 7fc26a7fc700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 0x7fc25806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.203+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc26c089c00 con 0x7fc27415e4a0 2023-10-14T11:23:50.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.203+0000 7fc2799bf700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 0x7fc25806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.215 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.204+0000 7fc2799bf700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 0x7fc25806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc2741f1f40 tx=0x7fc270012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.216 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.208+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc27415e910 con 0x7fc27415e4a0 2023-10-14T11:23:50.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.493+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc27415e910 con 0x7fc27415e4a0 2023-10-14T11:23:50.499 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.497+0000 7fc26a7fc700 1 -- 172.21.15.67:0/2634424286 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc27415e910 con 0x7fc27415e4a0 2023-10-14T11:23:50.501 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 msgr2=0x7fc25806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 0x7fc25806d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc2741f1f40 tx=0x7fc270012000 comp rx=0 tx=0).stop 2023-10-14T11:23:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 msgr2=0x7fc2740b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc26c007e40 tx=0x7fc26c00e3c0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.502 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 shutdown_connections 2023-10-14T11:23:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc25806af00 0x7fc25806d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc27415e4a0 0x7fc2740b01c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2740c52c0 0x7fc2741f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 --2- 172.21.15.67:0/2634424286 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc27415e0c0 0x7fc274151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.503 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 >> 172.21.15.67:0/2634424286 conn(0x7fc2740d0440 msgr2=0x7fc27415d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:50.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.499+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 shutdown_connections 2023-10-14T11:23:50.504 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.500+0000 7fc27bc23700 1 -- 172.21.15.67:0/2634424286 wait complete. 2023-10-14T11:23:50.513 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T11:23:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.638+0000 7f5ee7916700 1 Processor -- start 2023-10-14T11:23:50.640 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.638+0000 7f5ee7916700 1 -- start start 2023-10-14T11:23:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee7916700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ee015a600 0x7f5ee00cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee7916700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00cf720 con 0x7f5ee00cc1f0 2023-10-14T11:23:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee7916700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee006d0b0 con 0x7f5ee00ce960 2023-10-14T11:23:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee7916700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee006d390 con 0x7f5ee015a600 2023-10-14T11:23:50.643 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee4eb1700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f5ee00cc1f0 0x7f5ee006e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42228/0 (socket says 172.21.15.67:42228) 2023-10-14T11:23:50.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee4eb1700 1 -- 172.21.15.67:0/2532554036 learned_addr learned my addr 172.21.15.67:0/2532554036 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:50.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee56b2700 1 --2- 172.21.15.67:0/2532554036 >> v2:172.21.15.72:3300/0 conn(0x7f5ee015a600 0x7f5ee00cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992075894 0 0) 0x7f5ee00cf720 con 0x7f5ee00cc1f0 2023-10-14T11:23:50.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ecc0035b0 con 0x7f5ee00cc1f0 2023-10-14T11:23:50.644 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2810714162 0 0) 0x7f5ecc0035b0 con 0x7f5ee00cc1f0 2023-10-14T11:23:50.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee56b2700 1 -- 172.21.15.67:0/2532554036 >> v1:172.21.15.72:6789/0 conn(0x7f5ee00ce960 legacy=0x7f5ee00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee56b2700 1 -- 172.21.15.67:0/2532554036 >> v1:172.21.15.67:6789/0 conn(0x7f5ee00cc1f0 legacy=0x7f5ee006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee56b2700 1 -- 172.21.15.67:0/2532554036 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee006d670 con 0x7f5ee015a600 2023-10-14T11:23:50.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.639+0000 7f5ee56b2700 1 --2- 172.21.15.67:0/2532554036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee015a600 0x7f5ee00cb200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009840 tx=0x7f5edc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae9ed05fbeb002e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.645 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0001670 con 0x7f5ee015a600 2023-10-14T11:23:50.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc004030 con 0x7f5ee015a600 2023-10-14T11:23:50.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ed7fff700 1 -- 172.21.15.67:0/2532554036 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0043c0 con 0x7f5ee015a600 2023-10-14T11:23:50.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 -- 172.21.15.67:0/2532554036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee015a600 msgr2=0x7f5ee00cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2532554036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee015a600 0x7f5ee00cb200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5edc009840 tx=0x7f5edc009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:50.646 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 -- 172.21.15.67:0/2532554036 shutdown_connections 2023-10-14T11:23:50.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2532554036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee015a600 0x7f5ee00cb200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 -- 172.21.15.67:0/2532554036 >> 172.21.15.67:0/2532554036 conn(0x7f5ee00b16f0 msgr2=0x7f5ee00b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:50.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 -- 172.21.15.67:0/2532554036 shutdown_connections 2023-10-14T11:23:50.647 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.640+0000 7f5ee7916700 1 -- 172.21.15.67:0/2532554036 wait complete. 2023-10-14T11:23:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.641+0000 7f5ee7916700 1 Processor -- start 2023-10-14T11:23:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 -- start start 2023-10-14T11:23:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc1f0 0x7f5ee00b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 0x7f5ee014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c8750 con 0x7f5ee00ce960 2023-10-14T11:23:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00b3460 con 0x7f5ee00cc1f0 2023-10-14T11:23:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee7916700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c7b40 con 0x7f5ee015a600 2023-10-14T11:23:50.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee4eb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee4eb1700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42942/0 (socket says 172.21.15.67:42942) 2023-10-14T11:23:50.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.642+0000 7f5ee4eb1700 1 -- 172.21.15.67:0/2846898651 learned_addr learned my addr 172.21.15.67:0/2846898651 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:50.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee56b2700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc1f0 0x7f5ee00b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee5eb3700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 0x7f5ee014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 -- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 msgr2=0x7f5ee014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 0x7f5ee014c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 -- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc1f0 msgr2=0x7f5ee00b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc1f0 0x7f5ee00b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 -- 172.21.15.67:0/2846898651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0094a0 con 0x7f5ee00ce960 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee5eb3700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 0x7f5ee014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:50.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee4eb1700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c6a0 tx=0x7f5ed000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0005d70 con 0x7f5ee00ce960 2023-10-14T11:23:50.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0007070 con 0x7f5ee00ce960 2023-10-14T11:23:50.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee00c7e20 con 0x7f5ee00ce960 2023-10-14T11:23:50.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0007420 con 0x7f5ee00ce960 2023-10-14T11:23:50.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.643+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee00c83e0 con 0x7f5ee00ce960 2023-10-14T11:23:50.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.644+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee00c8900 con 0x7f5ee00ce960 2023-10-14T11:23:50.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.645+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ed0007580 con 0x7f5ee00ce960 2023-10-14T11:23:50.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.645+0000 7f5ed5ffb700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 0x7f5ec406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:50.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.645+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ed00886f0 con 0x7f5ee00ce960 2023-10-14T11:23:50.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.645+0000 7f5ee56b2700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 0x7f5ec406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:50.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.646+0000 7f5ee56b2700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 0x7f5ec406d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015d650 tx=0x7f5edc008000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:50.657 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.650+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ee00c8900 con 0x7f5ee00ce960 2023-10-14T11:23:50.938 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.936+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5ee00c8900 con 0x7f5ee00ce960 2023-10-14T11:23:50.939 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.938+0000 7f5ed5ffb700 1 -- 172.21.15.67:0/2846898651 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5ee00c8900 con 0x7f5ee00ce960 2023-10-14T11:23:50.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 msgr2=0x7f5ec406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 0x7f5ec406d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ee015d650 tx=0x7f5edc008000 comp rx=0 tx=0).stop 2023-10-14T11:23:50.942 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 msgr2=0x7f5ee00c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:50.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c6a0 tx=0x7f5ed000ca60 comp rx=0 tx=0).stop 2023-10-14T11:23:50.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 shutdown_connections 2023-10-14T11:23:50.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5ee015a600 0x7f5ee014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ee00cc1f0 0x7f5ee00b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.943 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5ec406af00 0x7f5ec406d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 --2- 172.21.15.67:0/2846898651 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5ee00ce960 0x7f5ee00c8be0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:50.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 >> 172.21.15.67:0/2846898651 conn(0x7f5ee00b16f0 msgr2=0x7f5ee01585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:50.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 shutdown_connections 2023-10-14T11:23:50.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:50.940+0000 7f5ee7916700 1 -- 172.21.15.67:0/2846898651 wait complete. 2023-10-14T11:23:50.954 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:51.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.078+0000 7f6e49746700 1 Processor -- start 2023-10-14T11:23:51.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.078+0000 7f6e49746700 1 -- start start 2023-10-14T11:23:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e49746700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e4406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e49746700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e4406adc0 0x7f6e44071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e49746700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4415de40 con 0x7f6e4415da60 2023-10-14T11:23:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e49746700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e441624b0 con 0x7f6e4406adc0 2023-10-14T11:23:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e49746700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441616f0 con 0x7f6e440c5be0 2023-10-14T11:23:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e437fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e4406adc0 0x7f6e44071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e437fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6e4406adc0 0x7f6e44071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42952/0 (socket says 172.21.15.67:42952) 2023-10-14T11:23:51.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e437fe700 1 -- 172.21.15.67:0/2413706521 learned_addr learned my addr 172.21.15.67:0/2413706521 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.079+0000 7f6e427fc700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e4406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e437fe700 1 -- 172.21.15.67:0/2413706521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 msgr2=0x7f6e4406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e437fe700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e4406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e437fe700 1 -- 172.21.15.67:0/2413706521 >> v1:172.21.15.72:6789/0 conn(0x7f6e4415da60 legacy=0x7f6e440c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e437fe700 1 -- 172.21.15.67:0/2413706521 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e441619d0 con 0x7f6e4406adc0 2023-10-14T11:23:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e427fc700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e4406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e437fe700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4406adc0 0x7f6e44071be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e50 tx=0x7f6e3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd2b82da72a4099 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e41ffb700 1 -- 172.21.15.67:0/2413706521 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00e070 con 0x7f6e4406adc0 2023-10-14T11:23:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e41ffb700 1 -- 172.21.15.67:0/2413706521 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c003a20 con 0x7f6e4406adc0 2023-10-14T11:23:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e41ffb700 1 -- 172.21.15.67:0/2413706521 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c003dd0 con 0x7f6e4406adc0 2023-10-14T11:23:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 -- 172.21.15.67:0/2413706521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4406adc0 msgr2=0x7f6e44071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4406adc0 0x7f6e44071be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e50 tx=0x7f6e3c00b330 comp rx=0 tx=0).stop 2023-10-14T11:23:51.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 -- 172.21.15.67:0/2413706521 shutdown_connections 2023-10-14T11:23:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4406adc0 0x7f6e44071be0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 --2- 172.21.15.67:0/2413706521 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e4406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 -- 172.21.15.67:0/2413706521 >> 172.21.15.67:0/2413706521 conn(0x7f6e440d0440 msgr2=0x7f6e440d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 -- 172.21.15.67:0/2413706521 shutdown_connections 2023-10-14T11:23:51.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.080+0000 7f6e49746700 1 -- 172.21.15.67:0/2413706521 wait complete. 2023-10-14T11:23:51.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.082+0000 7f6e49746700 1 Processor -- start 2023-10-14T11:23:51.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.082+0000 7f6e49746700 1 -- start start 2023-10-14T11:23:51.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4406adc0 0x7f6e44159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e441f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441f3a10 con 0x7f6e4415da60 2023-10-14T11:23:51.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440b34c0 con 0x7f6e4406adc0 2023-10-14T11:23:51.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e49746700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441f3450 con 0x7f6e440c5be0 2023-10-14T11:23:51.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e437fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42958/0 (socket says 172.21.15.67:42958) 2023-10-14T11:23:51.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.083+0000 7f6e437fe700 1 -- 172.21.15.67:0/4141217162 learned_addr learned my addr 172.21.15.67:0/4141217162 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:51.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e427fc700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e441f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e42ffd700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4406adc0 0x7f6e44159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 -- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 msgr2=0x7f6e441f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e441f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 -- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4406adc0 msgr2=0x7f6e44159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4406adc0 0x7f6e44159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 -- 172.21.15.67:0/4141217162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c009b30 con 0x7f6e4415da60 2023-10-14T11:23:51.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e437fe700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdfc0 tx=0x7f6e3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c004440 con 0x7f6e4415da60 2023-10-14T11:23:51.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c0045a0 con 0x7f6e4415da60 2023-10-14T11:23:51.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e441f3730 con 0x7f6e4415da60 2023-10-14T11:23:51.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c004950 con 0x7f6e4415da60 2023-10-14T11:23:51.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.084+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4415a340 con 0x7f6e4415da60 2023-10-14T11:23:51.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.085+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e440b3670 con 0x7f6e4415da60 2023-10-14T11:23:51.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.085+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e3c025450 con 0x7f6e4415da60 2023-10-14T11:23:51.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.086+0000 7f6e2b7fe700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 0x7f6e3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.086+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e3c08ab00 con 0x7f6e4415da60 2023-10-14T11:23:51.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.086+0000 7f6e42ffd700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 0x7f6e3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.086+0000 7f6e42ffd700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 0x7f6e3006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6e38003e60 tx=0x7f6e38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.090+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e440b3670 con 0x7f6e4415da60 2023-10-14T11:23:51.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.292+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e440b3630 con 0x7f6e4415da60 2023-10-14T11:23:51.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.293+0000 7f6e2b7fe700 1 -- 172.21.15.67:0/4141217162 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12797 (secure 0 0 0) 0x7f6e3c0599a0 con 0x7f6e4415da60 2023-10-14T11:23:51.296 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:51.296 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":28,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:23:47.824889+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:51.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 msgr2=0x7f6e3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 0x7f6e3006d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6e38003e60 tx=0x7f6e38009040 comp rx=0 tx=0).stop 2023-10-14T11:23:51.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 msgr2=0x7f6e44158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdfc0 tx=0x7f6e3c004ad0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 shutdown_connections 2023-10-14T11:23:51.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6e3006af00 0x7f6e3006d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6e4415da60 0x7f6e44158d50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6e4406adc0 0x7f6e44159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 --2- 172.21.15.67:0/4141217162 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6e440c5be0 0x7f6e441f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 >> 172.21.15.67:0/4141217162 conn(0x7f6e440d0440 msgr2=0x7f6e44155fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:51.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 shutdown_connections 2023-10-14T11:23:51.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.295+0000 7f6e49746700 1 -- 172.21.15.67:0/4141217162 wait complete. 2023-10-14T11:23:51.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T11:22:52.459916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T11:23:51.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T11:23:51.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.436+0000 7f0b83be9700 1 Processor -- start 2023-10-14T11:23:51.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.436+0000 7f0b83be9700 1 -- start start 2023-10-14T11:23:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b83be9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0b7c0cd0d0 0x7f0b7c0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b83be9700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0ad3c0 con 0x7f0b7c15ae40 2023-10-14T11:23:51.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b83be9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0ce8f0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b83be9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0d1300 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b82186700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0b7c15ae40 0x7f0b7c0cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42260/0 (socket says 172.21.15.67:42260) 2023-10-14T11:23:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b82186700 1 -- 172.21.15.67:0/2208365877 learned_addr learned my addr 172.21.15.67:0/2208365877 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b81184700 1 --2- 172.21.15.67:0/2208365877 >> v2:172.21.15.72:3300/0 conn(0x7f0b7c0cd0d0 0x7f0b7c0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.437+0000 7f0b80983700 1 -- 172.21.15.67:0/2208365877 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503038575 0 0) 0x7f0b7c0ad3c0 con 0x7f0b7c15ae40 2023-10-14T11:23:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b80983700 1 -- 172.21.15.67:0/2208365877 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b680057c0 con 0x7f0b7c15ae40 2023-10-14T11:23:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b81184700 1 -- 172.21.15.67:0/2208365877 >> v1:172.21.15.72:6789/0 conn(0x7f0b7c15aa60 legacy=0x7f0b7c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b81184700 1 -- 172.21.15.67:0/2208365877 >> v1:172.21.15.67:6789/0 conn(0x7f0b7c15ae40 legacy=0x7f0b7c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b81184700 1 -- 172.21.15.67:0/2208365877 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0ceb50 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b81184700 1 --2- 172.21.15.67:0/2208365877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c0cd0d0 0x7f0b7c0ce3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009840 tx=0x7f0b78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5af8ab858be50fb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b80983700 1 -- 172.21.15.67:0/2208365877 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011830 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b80983700 1 -- 172.21.15.67:0/2208365877 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78011990 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.438+0000 7f0b80983700 1 -- 172.21.15.67:0/2208365877 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78011d20 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 -- 172.21.15.67:0/2208365877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c0cd0d0 msgr2=0x7f0b7c0ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 --2- 172.21.15.67:0/2208365877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c0cd0d0 0x7f0b7c0ce3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009840 tx=0x7f0b78009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 -- 172.21.15.67:0/2208365877 shutdown_connections 2023-10-14T11:23:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 --2- 172.21.15.67:0/2208365877 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c0cd0d0 0x7f0b7c0ce3b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 -- 172.21.15.67:0/2208365877 >> 172.21.15.67:0/2208365877 conn(0x7f0b7c0d04b0 msgr2=0x7f0b7c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 -- 172.21.15.67:0/2208365877 shutdown_connections 2023-10-14T11:23:51.446 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.439+0000 7f0b83be9700 1 -- 172.21.15.67:0/2208365877 wait complete. 2023-10-14T11:23:51.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.440+0000 7f0b83be9700 1 Processor -- start 2023-10-14T11:23:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.440+0000 7f0b83be9700 1 -- start start 2023-10-14T11:23:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7c0cd0d0 0x7f0b7c1eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c15ae40 0x7f0b7c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c38b0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c7ca0 con 0x7f0b7c15ae40 2023-10-14T11:23:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b83be9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0c7f80 con 0x7f0b7c0cd0d0 2023-10-14T11:23:51.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42970/0 (socket says 172.21.15.67:42970) 2023-10-14T11:23:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 -- 172.21.15.67:0/1606932288 learned_addr learned my addr 172.21.15.67:0/1606932288 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b82186700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c15ae40 0x7f0b7c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81985700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7c0cd0d0 0x7f0b7c1eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 -- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7c0cd0d0 msgr2=0x7f0b7c1eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7c0cd0d0 0x7f0b7c1eeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 -- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c15ae40 msgr2=0x7f0b7c0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c15ae40 0x7f0b7c0b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 -- 172.21.15.67:0/1606932288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780094a0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b81184700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009b90 tx=0x7f0b78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.441+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b780036a0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.442+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7801e070 con 0x7f0b7c15aa60 2023-10-14T11:23:51.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.442+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0c8260 con 0x7f0b7c15aa60 2023-10-14T11:23:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.442+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78003a60 con 0x7f0b7c15aa60 2023-10-14T11:23:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.442+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c0c8820 con 0x7f0b7c15aa60 2023-10-14T11:23:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.443+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c0c8a10 con 0x7f0b7c15aa60 2023-10-14T11:23:51.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.443+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b78003bc0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.443+0000 7f0b727fc700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 0x7f0b6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.443+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0b7808a080 con 0x7f0b7c15aa60 2023-10-14T11:23:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.443+0000 7f0b81985700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 0x7f0b6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.444+0000 7f0b81985700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 0x7f0b6006d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007fd0 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.448+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b78055510 con 0x7f0b7c15aa60 2023-10-14T11:23:51.651 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.649+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b7c04ebb0 con 0x7f0b7c15aa60 2023-10-14T11:23:51.652 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.650+0000 7f0b727fc700 1 -- 172.21.15.67:0/1606932288 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b78058b30 con 0x7f0b7c15aa60 2023-10-14T11:23:51.652 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2023-10-14T11:23:51.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 msgr2=0x7f0b6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 0x7f0b6006d3c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007fd0 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2023-10-14T11:23:51.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 msgr2=0x7f0b7c0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009b90 tx=0x7f0b78004750 comp rx=0 tx=0).stop 2023-10-14T11:23:51.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 shutdown_connections 2023-10-14T11:23:51.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0b7c15ae40 0x7f0b7c0b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0b7c0cd0d0 0x7f0b7c1eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f0b6006af00 0x7f0b6006d3c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 --2- 172.21.15.67:0/1606932288 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f0b7c15aa60 0x7f0b7c0b5b80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 >> 172.21.15.67:0/1606932288 conn(0x7f0b7c0d04b0 msgr2=0x7f0b7c1589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:51.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 shutdown_connections 2023-10-14T11:23:51.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.652+0000 7f0b83be9700 1 -- 172.21.15.67:0/1606932288 wait complete. 2023-10-14T11:23:51.666 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T11:23:51.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.789+0000 7f1a1bfdb700 1 Processor -- start 2023-10-14T11:23:51.791 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.789+0000 7f1a1bfdb700 1 -- start start 2023-10-14T11:23:51.794 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a1bfdb700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1a140ceb30 0x7f1a140b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a1bfdb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140cef10 con 0x7f1a140cdc30 2023-10-14T11:23:51.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a1bfdb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140d2090 con 0x7f1a140d01b0 2023-10-14T11:23:51.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a1bfdb700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1415deb0 con 0x7f1a140ceb30 2023-10-14T11:23:51.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19d77700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1a140ceb30 0x7f1a140b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19576700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1a140cdc30 0x7f1a140cfaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42270/0 (socket says 172.21.15.67:42270) 2023-10-14T11:23:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19576700 1 -- 172.21.15.67:0/1348320765 learned_addr learned my addr 172.21.15.67:0/1348320765 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19d77700 1 -- 172.21.15.67:0/1348320765 >> v1:172.21.15.72:6789/0 conn(0x7f1a140d01b0 legacy=0x7f1a1415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19d77700 1 -- 172.21.15.67:0/1348320765 >> v1:172.21.15.67:6789/0 conn(0x7f1a140cdc30 legacy=0x7f1a140cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.796 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19d77700 1 -- 172.21.15.67:0/1348320765 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140d22e0 con 0x7f1a140ceb30 2023-10-14T11:23:51.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a18d75700 1 -- 172.21.15.67:0/1348320765 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300559208 0 0) 0x7f1a140cef10 con 0x7f1a140cdc30 2023-10-14T11:23:51.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.790+0000 7f1a19d77700 1 --2- 172.21.15.67:0/1348320765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140ceb30 0x7f1a140b04c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009840 tx=0x7f1a10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74836c5e6e736e93 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a18d75700 1 -- 172.21.15.67:0/1348320765 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004230 con 0x7f1a140ceb30 2023-10-14T11:23:51.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a18d75700 1 -- 172.21.15.67:0/1348320765 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10004390 con 0x7f1a140ceb30 2023-10-14T11:23:51.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a18d75700 1 -- 172.21.15.67:0/1348320765 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100036a0 con 0x7f1a140ceb30 2023-10-14T11:23:51.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1348320765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140ceb30 msgr2=0x7f1a140b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1348320765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140ceb30 0x7f1a140b04c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009840 tx=0x7f1a10009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:51.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1348320765 shutdown_connections 2023-10-14T11:23:51.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1348320765 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140ceb30 0x7f1a140b04c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1348320765 >> 172.21.15.67:0/1348320765 conn(0x7f1a140d1570 msgr2=0x7f1a140d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1348320765 shutdown_connections 2023-10-14T11:23:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.791+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1348320765 wait complete. 2023-10-14T11:23:51.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.792+0000 7f1a1bfdb700 1 Processor -- start 2023-10-14T11:23:51.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.792+0000 7f1a1bfdb700 1 -- start start 2023-10-14T11:23:51.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a140cdc30 0x7f1a140b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.806 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 0x7f1a14159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1406fed0 con 0x7f1a140d01b0 2023-10-14T11:23:51.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140b4680 con 0x7f1a140cdc30 2023-10-14T11:23:51.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1bfdb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1406f880 con 0x7f1a140ceb30 2023-10-14T11:23:51.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1a578700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1a578700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:42986/0 (socket says 172.21.15.67:42986) 2023-10-14T11:23:51.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a1a578700 1 -- 172.21.15.67:0/1607220006 learned_addr learned my addr 172.21.15.67:0/1607220006 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a19576700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 0x7f1a14159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.793+0000 7f1a19d77700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a140cdc30 0x7f1a140b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 -- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 msgr2=0x7f1a14159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 0x7f1a14159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 -- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a140cdc30 msgr2=0x7f1a140b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a140cdc30 0x7f1a140b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 -- 172.21.15.67:0/1607220006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100094a0 con 0x7f1a140d01b0 2023-10-14T11:23:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a19576700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 0x7f1a14159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1a578700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00b970 tx=0x7f1a0c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00c9b0 con 0x7f1a140d01b0 2023-10-14T11:23:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00cb10 con 0x7f1a140d01b0 2023-10-14T11:23:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1406fb60 con 0x7f1a140d01b0 2023-10-14T11:23:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c014440 con 0x7f1a140d01b0 2023-10-14T11:23:51.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.794+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a140b6dc0 con 0x7f1a140d01b0 2023-10-14T11:23:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.795+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a14070080 con 0x7f1a140d01b0 2023-10-14T11:23:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.795+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1a0c01d3b0 con 0x7f1a140d01b0 2023-10-14T11:23:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.796+0000 7f1a0a7fc700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 0x7f19f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:51.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.796+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a0c088e20 con 0x7f1a140d01b0 2023-10-14T11:23:51.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.796+0000 7f1a19d77700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 0x7f19f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:51.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.797+0000 7f1a19d77700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 0x7f19f806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a100090b0 tx=0x7f1a10008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:51.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:51.800+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1a0c0542b0 con 0x7f1a140d01b0 2023-10-14T11:23:52.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.003+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1a1404ebb0 con 0x7f1a140d01b0 2023-10-14T11:23:52.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.004+0000 7f1a0a7fc700 1 -- 172.21.15.67:0/1607220006 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1a0c0578d0 con 0x7f1a140d01b0 2023-10-14T11:23:52.006 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:52.006 INFO:teuthology.orchestra.run.smithi067.stdout:[ 2023-10-14T11:23:52.007 INFO:teuthology.orchestra.run.smithi067.stdout: { 2023-10-14T11:23:52.007 INFO:teuthology.orchestra.run.smithi067.stdout: "poolnum": 1, 2023-10-14T11:23:52.007 INFO:teuthology.orchestra.run.smithi067.stdout: "poolname": ".mgr" 2023-10-14T11:23:52.007 INFO:teuthology.orchestra.run.smithi067.stdout: } 2023-10-14T11:23:52.007 INFO:teuthology.orchestra.run.smithi067.stdout:] 2023-10-14T11:23:52.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 msgr2=0x7f19f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 0x7f19f806d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a100090b0 tx=0x7f1a10008030 comp rx=0 tx=0).stop 2023-10-14T11:23:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 msgr2=0x7f1a1415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00b970 tx=0x7f1a0c00bd30 comp rx=0 tx=0).stop 2023-10-14T11:23:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 shutdown_connections 2023-10-14T11:23:52.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f19f806af00 0x7f19f806d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1a140d01b0 0x7f1a1415a180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a140cdc30 0x7f1a140b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 --2- 172.21.15.67:0/1607220006 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1a140ceb30 0x7f1a14159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 >> 172.21.15.67:0/1607220006 conn(0x7f1a140d1570 msgr2=0x7f1a140cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:52.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 shutdown_connections 2023-10-14T11:23:52.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.006+0000 7f1a1bfdb700 1 -- 172.21.15.67:0/1607220006 wait complete. 2023-10-14T11:23:52.020 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T11:23:52.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T11:23:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.147+0000 7fbc38c37700 1 Processor -- start 2023-10-14T11:23:52.149 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.147+0000 7fbc38c37700 1 -- start start 2023-10-14T11:23:52.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc38c37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc38c37700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc38c37700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc340c5720 con 0x7fbc340d2180 2023-10-14T11:23:52.152 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc38c37700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc340cd4f0 con 0x7fbc340ce5e0 2023-10-14T11:23:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc38c37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340cd7d0 con 0x7fbc340ce200 2023-10-14T11:23:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc3259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc31d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc3259c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:45262/0 (socket says 172.21.15.67:45262) 2023-10-14T11:23:52.153 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc31d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:43398/0 (socket says 172.21.15.67:43398) 2023-10-14T11:23:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc31d9b700 1 -- 172.21.15.67:0/3605575260 learned_addr learned my addr 172.21.15.67:0/3605575260 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.148+0000 7fbc32d9d700 1 --1- 172.21.15.67:0/3605575260 >> v1:172.21.15.72:6789/0 conn(0x7fbc340d2180 0x7fbc340cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:49110/0 (socket says 172.21.15.67:49110) 2023-10-14T11:23:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3159a700 1 -- 172.21.15.67:0/3605575260 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978984977 0 0) 0x7fbc340c5720 con 0x7fbc340d2180 2023-10-14T11:23:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3159a700 1 -- 172.21.15.67:0/3605575260 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c0035b0 con 0x7fbc340d2180 2023-10-14T11:23:52.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3259c700 1 -- 172.21.15.67:0/3605575260 >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 msgr2=0x7fbc3415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:52.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3259c700 1 --2- 172.21.15.67:0/3605575260 >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3259c700 1 -- 172.21.15.67:0/3605575260 >> v1:172.21.15.72:6789/0 conn(0x7fbc340d2180 legacy=0x7fbc340cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3259c700 1 -- 172.21.15.67:0/3605575260 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340c50d0 con 0x7fbc340ce200 2023-10-14T11:23:52.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc31d9b700 1 --2- 172.21.15.67:0/3605575260 >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3259c700 1 --2- 172.21.15.67:0/3605575260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009840 tx=0x7fbc28009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff6f30b7bc489a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3159a700 1 -- 172.21.15.67:0/3605575260 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011830 con 0x7fbc340ce200 2023-10-14T11:23:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3159a700 1 -- 172.21.15.67:0/3605575260 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28011990 con 0x7fbc340ce200 2023-10-14T11:23:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.149+0000 7fbc3159a700 1 -- 172.21.15.67:0/3605575260 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011d20 con 0x7fbc340ce200 2023-10-14T11:23:52.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 -- 172.21.15.67:0/3605575260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 msgr2=0x7fbc340ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 --2- 172.21.15.67:0/3605575260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009840 tx=0x7fbc28009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 -- 172.21.15.67:0/3605575260 shutdown_connections 2023-10-14T11:23:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 --2- 172.21.15.67:0/3605575260 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce200 0x7fbc340ccca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 --2- 172.21.15.67:0/3605575260 >> v2:172.21.15.72:3300/0 conn(0x7fbc340ce5e0 0x7fbc3415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 -- 172.21.15.67:0/3605575260 >> 172.21.15.67:0/3605575260 conn(0x7fbc340d1580 msgr2=0x7fbc340d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 -- 172.21.15.67:0/3605575260 shutdown_connections 2023-10-14T11:23:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.150+0000 7fbc38c37700 1 -- 172.21.15.67:0/3605575260 wait complete. 2023-10-14T11:23:52.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.151+0000 7fbc38c37700 1 Processor -- start 2023-10-14T11:23:52.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.151+0000 7fbc38c37700 1 -- start start 2023-10-14T11:23:52.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc340ce200 0x7fbc3414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce5e0 0x7fbc3415d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c9390 con 0x7fbc340d2180 2023-10-14T11:23:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34150090 con 0x7fbc340ce200 2023-10-14T11:23:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc38c37700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c8780 con 0x7fbc340ce5e0 2023-10-14T11:23:52.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43000/0 (socket says 172.21.15.67:43000) 2023-10-14T11:23:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 -- 172.21.15.67:0/1496067830 learned_addr learned my addr 172.21.15.67:0/1496067830 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc3259c700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc340ce200 0x7fbc3414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc31d9b700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce5e0 0x7fbc3415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 -- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce5e0 msgr2=0x7fbc3415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce5e0 0x7fbc3415d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 -- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc340ce200 msgr2=0x7fbc3414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc340ce200 0x7fbc3414f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.152+0000 7fbc32d9d700 1 -- 172.21.15.67:0/1496067830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc24009550 con 0x7fbc340d2180 2023-10-14T11:23:52.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc32d9d700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00cbf0 tx=0x7fbc2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00ab80 con 0x7fbc340d2180 2023-10-14T11:23:52.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00ace0 con 0x7fbc340d2180 2023-10-14T11:23:52.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc280094a0 con 0x7fbc340d2180 2023-10-14T11:23:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c007290 con 0x7fbc340d2180 2023-10-14T11:23:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.153+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc340c8d40 con 0x7fbc340d2180 2023-10-14T11:23:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.154+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc340c9500 con 0x7fbc340d2180 2023-10-14T11:23:52.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.154+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc2c0073f0 con 0x7fbc340d2180 2023-10-14T11:23:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.154+0000 7fbc22ffd700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 0x7fbc1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.155+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc2c0890e0 con 0x7fbc340d2180 2023-10-14T11:23:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.155+0000 7fbc3259c700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 0x7fbc1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.155+0000 7fbc3259c700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 0x7fbc1406d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.159+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc2c054570 con 0x7fbc340d2180 2023-10-14T11:23:52.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.360+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbc3404ebb0 con 0x7fbc340d2180 2023-10-14T11:23:52.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.822+0000 7fbc22ffd700 1 -- 172.21.15.67:0/1496067830 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v29) v1 ==== 148+0+0 (secure 0 0 0) 0x7fbc2c0170b0 con 0x7fbc340d2180 2023-10-14T11:23:52.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.825+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 msgr2=0x7fbc1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.825+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 0x7fbc1406d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28008030 comp rx=0 tx=0).stop 2023-10-14T11:23:52.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.825+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 msgr2=0x7fbc3415d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.827 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.825+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00cbf0 tx=0x7fbc2c00a060 comp rx=0 tx=0).stop 2023-10-14T11:23:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 shutdown_connections 2023-10-14T11:23:52.828 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbc1406af00 0x7fbc1406d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbc340d2180 0x7fbc3415d780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc340ce200 0x7fbc3414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 --2- 172.21.15.67:0/1496067830 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbc340ce5e0 0x7fbc3415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 >> 172.21.15.67:0/1496067830 conn(0x7fbc340d1580 msgr2=0x7fbc3406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 shutdown_connections 2023-10-14T11:23:52.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.826+0000 7fbc38c37700 1 -- 172.21.15.67:0/1496067830 wait complete. 2023-10-14T11:23:52.831 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'testcephfs1_metadata' created 2023-10-14T11:23:52.844 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T11:23:52.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.975+0000 7f1b02bb5700 1 Processor -- start 2023-10-14T11:23:52.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b02bb5700 1 -- start start 2023-10-14T11:23:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b02bb5700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1afc06b3b0 0x7f1afc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b02bb5700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0b0f90 con 0x7f1afc0b0bb0 2023-10-14T11:23:52.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b02bb5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1afc0cc820 con 0x7f1afc0b1250 2023-10-14T11:23:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b02bb5700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1afc0cde00 con 0x7f1afc06b3b0 2023-10-14T11:23:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1afbfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f1afc06b3b0 0x7f1afc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b00951700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1afc0b0bb0 0x7f1afc0cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42298/0 (socket says 172.21.15.67:42298) 2023-10-14T11:23:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.976+0000 7f1b00951700 1 -- 172.21.15.67:0/3722274042 learned_addr learned my addr 172.21.15.67:0/3722274042 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:52.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afbfff700 1 -- 172.21.15.67:0/3722274042 >> v1:172.21.15.72:6789/0 conn(0x7f1afc0b1250 legacy=0x7f1afc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:52.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afbfff700 1 -- 172.21.15.67:0/3722274042 >> v1:172.21.15.67:6789/0 conn(0x7f1afc0b0bb0 legacy=0x7f1afc0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afbfff700 1 -- 172.21.15.67:0/3722274042 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc0ccb00 con 0x7f1afc06b3b0 2023-10-14T11:23:52.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afbfff700 1 --2- 172.21.15.67:0/3722274042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc06b3b0 0x7f1afc0cd8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009840 tx=0x7f1ae8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec9b3923d345eae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afb7fe700 1 -- 172.21.15.67:0/3722274042 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8004230 con 0x7f1afc06b3b0 2023-10-14T11:23:52.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afb7fe700 1 -- 172.21.15.67:0/3722274042 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8004390 con 0x7f1afc06b3b0 2023-10-14T11:23:52.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.977+0000 7f1afb7fe700 1 -- 172.21.15.67:0/3722274042 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae80036a0 con 0x7f1afc06b3b0 2023-10-14T11:23:52.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 -- 172.21.15.67:0/3722274042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc06b3b0 msgr2=0x7f1afc0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/3722274042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc06b3b0 0x7f1afc0cd8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009840 tx=0x7f1ae8009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:52.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 -- 172.21.15.67:0/3722274042 shutdown_connections 2023-10-14T11:23:52.983 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/3722274042 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc06b3b0 0x7f1afc0cd8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 -- 172.21.15.67:0/3722274042 >> 172.21.15.67:0/3722274042 conn(0x7f1afc0d04b0 msgr2=0x7f1afc0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:52.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 -- 172.21.15.67:0/3722274042 shutdown_connections 2023-10-14T11:23:52.984 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.978+0000 7f1b02bb5700 1 -- 172.21.15.67:0/3722274042 wait complete. 2023-10-14T11:23:52.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.979+0000 7f1b02bb5700 1 Processor -- start 2023-10-14T11:23:52.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.979+0000 7f1b02bb5700 1 -- start start 2023-10-14T11:23:52.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 0x7f1afc0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 0x7f1afc0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c8950 con 0x7f1afc0b1250 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c7ac0 con 0x7f1afc0b0bb0 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b02bb5700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1afc0c7d40 con 0x7f1afc06b3b0 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43014/0 (socket says 172.21.15.67:43014) 2023-10-14T11:23:52.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 -- 172.21.15.67:0/1152774983 learned_addr learned my addr 172.21.15.67:0/1152774983 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:52.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b00951700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 0x7f1afc0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1afbfff700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 0x7f1afc0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 -- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 msgr2=0x7f1afc0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 0x7f1afc0ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 -- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 msgr2=0x7f1afc0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:52.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 0x7f1afc0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:52.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 -- 172.21.15.67:0/1152774983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae80094a0 con 0x7f1afc0b1250 2023-10-14T11:23:52.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b00951700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 0x7f1afc0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:52.990 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1afbfff700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 0x7f1afc0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:52.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1b01152700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1af400b9c0 tx=0x7f1af400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af400c9d0 con 0x7f1afc0b1250 2023-10-14T11:23:52.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.980+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af400cb30 con 0x7f1afc0b1250 2023-10-14T11:23:52.991 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.981+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1afc0c8020 con 0x7f1afc0b1250 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.981+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4014440 con 0x7f1afc0b1250 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.981+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1afc0c85e0 con 0x7f1afc0b1250 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.981+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1afc0c8b00 con 0x7f1afc0b1250 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.982+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1af4006d50 con 0x7f1afc0b1250 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.982+0000 7f1af97fa700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 0x7f1ae006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:52.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.983+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5232+0+0 (secure 0 0 0) 0x7f1af4088f50 con 0x7f1afc0b1250 2023-10-14T11:23:52.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.983+0000 7f1b00951700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 0x7f1ae006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:52.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.983+0000 7f1b00951700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 0x7f1ae006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:52.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:52.987+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1af4054160 con 0x7f1afc0b1250 2023-10-14T11:23:53.194 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.192+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1afc04ebb0 con 0x7f1afc0b1250 2023-10-14T11:23:53.826 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.824+0000 7f1af97fa700 1 -- 172.21.15.67:0/1152774983 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v30) v1 ==== 180+0+0 (secure 0 0 0) 0x7f1af4057780 con 0x7f1afc0b1250 2023-10-14T11:23:53.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 msgr2=0x7f1ae006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:53.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 0x7f1ae006d3c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0009040 comp rx=0 tx=0).stop 2023-10-14T11:23:53.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 msgr2=0x7f1afc0c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:53.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1af400b9c0 tx=0x7f1af400bd80 comp rx=0 tx=0).stop 2023-10-14T11:23:53.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 shutdown_connections 2023-10-14T11:23:53.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f1ae006af00 0x7f1ae006d3c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:53.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f1afc0b1250 0x7f1afc0c6350 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:53.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f1afc06b3b0 0x7f1afc0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:53.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 --2- 172.21.15.67:0/1152774983 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1afc0b0bb0 0x7f1afc0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:53.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.828+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 >> 172.21.15.67:0/1152774983 conn(0x7f1afc0d04b0 msgr2=0x7f1afc0cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:53.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.829+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 shutdown_connections 2023-10-14T11:23:53.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.829+0000 7f1b02bb5700 1 -- 172.21.15.67:0/1152774983 wait complete. 2023-10-14T11:23:53.834 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'testcephfs1_data' created 2023-10-14T11:23:53.860 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T11:23:53.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 Processor -- start 2023-10-14T11:23:53.995 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 -- start start 2023-10-14T11:23:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0a40b1140 0x7fd0a406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:53.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a415cd20 con 0x7fd0a40b08d0 2023-10-14T11:23:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40b15d0 con 0x7fd0a415f4d0 2023-10-14T11:23:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.992+0000 7fd0aaeaa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a415bee0 con 0x7fd0a40b1140 2023-10-14T11:23:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a8c46700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fd0a40b08d0 0x7fd0a415c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42312/0 (socket says 172.21.15.67:42312) 2023-10-14T11:23:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a8c46700 1 -- 172.21.15.67:0/2463530355 learned_addr learned my addr 172.21.15.67:0/2463530355 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:53.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a3fff700 1 --2- 172.21.15.67:0/2463530355 >> v2:172.21.15.72:3300/0 conn(0x7fd0a40b1140 0x7fd0a406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a37fe700 1 -- 172.21.15.67:0/2463530355 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397366440 0 0) 0x7fd0a415cd20 con 0x7fd0a40b08d0 2023-10-14T11:23:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a37fe700 1 -- 172.21.15.67:0/2463530355 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0940035b0 con 0x7fd0a40b08d0 2023-10-14T11:23:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a3fff700 1 -- 172.21.15.67:0/2463530355 >> v1:172.21.15.72:6789/0 conn(0x7fd0a415f4d0 legacy=0x7fd0a40cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a3fff700 1 -- 172.21.15.67:0/2463530355 >> v1:172.21.15.67:6789/0 conn(0x7fd0a40b08d0 legacy=0x7fd0a415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:53.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a3fff700 1 -- 172.21.15.67:0/2463530355 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40b18b0 con 0x7fd0a40b1140 2023-10-14T11:23:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a3fff700 1 --2- 172.21.15.67:0/2463530355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a40b1140 0x7fd0a406b1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd090009840 tx=0x7fd090009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=339fbe092a6c41da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.993+0000 7fd0a37fe700 1 -- 172.21.15.67:0/2463530355 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011830 con 0x7fd0a40b1140 2023-10-14T11:23:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0a37fe700 1 -- 172.21.15.67:0/2463530355 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd090011990 con 0x7fd0a40b1140 2023-10-14T11:23:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0a37fe700 1 -- 172.21.15.67:0/2463530355 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090011d20 con 0x7fd0a40b1140 2023-10-14T11:23:54.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/2463530355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a40b1140 msgr2=0x7fd0a406b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/2463530355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a40b1140 0x7fd0a406b1e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd090009840 tx=0x7fd090009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/2463530355 shutdown_connections 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/2463530355 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a40b1140 0x7fd0a406b1e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/2463530355 >> 172.21.15.67:0/2463530355 conn(0x7fd0a40d04b0 msgr2=0x7fd0a40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/2463530355 shutdown_connections 2023-10-14T11:23:54.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.994+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/2463530355 wait complete. 2023-10-14T11:23:54.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.995+0000 7fd0aaeaa700 1 Processor -- start 2023-10-14T11:23:54.004 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.995+0000 7fd0aaeaa700 1 -- start start 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a415f4d0 0x7fd0a40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 0x7fd0a415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40b36b0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4151350 con 0x7fd0a415f4d0 2023-10-14T11:23:54.005 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0aaeaa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40ae650 con 0x7fd0a41f35d0 2023-10-14T11:23:54.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0a8c46700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:54.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0a8c46700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43024/0 (socket says 172.21.15.67:43024) 2023-10-14T11:23:54.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0a8c46700 1 -- 172.21.15.67:0/773531391 learned_addr learned my addr 172.21.15.67:0/773531391 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:54.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.996+0000 7fd0a3fff700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a415f4d0 0x7fd0a40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:54.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a9447700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 0x7fd0a415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:54.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 -- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 msgr2=0x7fd0a415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:54.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 0x7fd0a415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 -- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a415f4d0 msgr2=0x7fd0a40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:54.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a415f4d0 0x7fd0a40cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 -- 172.21.15.67:0/773531391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094a0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a9447700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 0x7fd0a415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:54.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a8c46700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd098001eb0 tx=0x7fd09800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:54.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098005d70 con 0x7fd0a40b08d0 2023-10-14T11:23:54.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980070d0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40ae930 con 0x7fd0a40b08d0 2023-10-14T11:23:54.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098007460 con 0x7fd0a40b08d0 2023-10-14T11:23:54.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.997+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40aeef0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.998+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a40d1120 con 0x7fd0a40b08d0 2023-10-14T11:23:54.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.999+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0980075c0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.999+0000 7fd0a17fa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 0x7fd08806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:54.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.999+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fd098088a40 con 0x7fd0a40b08d0 2023-10-14T11:23:54.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:53.999+0000 7fd0a3fff700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 0x7fd08806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:54.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.000+0000 7fd0a3fff700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 0x7fd08806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd0900090b0 tx=0x7fd090008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:54.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.004+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd09808ae60 con 0x7fd0a40b08d0 2023-10-14T11:23:54.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.249+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7fd0a404ebb0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.842+0000 7fd0a17fa700 1 -- 172.21.15.67:0/773531391 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd0980170d0 con 0x7fd0a40b08d0 2023-10-14T11:23:54.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.852+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 msgr2=0x7fd08806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:54.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.852+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 0x7fd08806d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd0900090b0 tx=0x7fd090008030 comp rx=0 tx=0).stop 2023-10-14T11:23:54.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.852+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 msgr2=0x7fd0a4150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:54.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.852+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd098001eb0 tx=0x7fd09800c7b0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 shutdown_connections 2023-10-14T11:23:54.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd0a41f35d0 0x7fd0a415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd08806af00 0x7fd08806d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd0a40b08d0 0x7fd0a4150e10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 --2- 172.21.15.67:0/773531391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0a415f4d0 0x7fd0a40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:54.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.864+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 >> 172.21.15.67:0/773531391 conn(0x7fd0a40d04b0 msgr2=0x7fd0a415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:54.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.865+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 shutdown_connections 2023-10-14T11:23:54.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:54.865+0000 7fd0aaeaa700 1 -- 172.21.15.67:0/773531391 wait complete. 2023-10-14T11:23:54.870 INFO:teuthology.orchestra.run.smithi067.stderr:new fs with metadata pool 4 and data pool 5 2023-10-14T11:23:54.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:55.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.010+0000 7f78f43ae700 1 Processor -- start 2023-10-14T11:23:55.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.010+0000 7f78f43ae700 1 -- start start 2023-10-14T11:23:55.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f43ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78ec0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f43ae700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0cfa80 con 0x7f78ec0c52c0 2023-10-14T11:23:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f43ae700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ec0cfd60 con 0x7f78ec15e0c0 2023-10-14T11:23:55.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f43ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0d0040 con 0x7f78ec15e4a0 2023-10-14T11:23:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f294b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f78ec0c52c0 0x7f78ec06fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42344/0 (socket says 172.21.15.67:42344) 2023-10-14T11:23:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f294b700 1 -- 172.21.15.67:0/2708052019 learned_addr learned my addr 172.21.15.67:0/2708052019 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.011+0000 7f78f1949700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78ec0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358717265 0 0) 0x7f78ec0cfa80 con 0x7f78ec0c52c0 2023-10-14T11:23:55.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78d80035b0 con 0x7f78ec0c52c0 2023-10-14T11:23:55.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834536049 0 0) 0x7f78ec0cfd60 con 0x7f78ec15e0c0 2023-10-14T11:23:55.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec0cfa80 con 0x7f78ec15e0c0 2023-10-14T11:23:55.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1011897681 0 0) 0x7f78d80035b0 con 0x7f78ec0c52c0 2023-10-14T11:23:55.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 msgr2=0x7f78ec0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78ec0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 >> v1:172.21.15.72:6789/0 conn(0x7f78ec15e0c0 legacy=0x7f78ec072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec06f570 con 0x7f78ec0c52c0 2023-10-14T11:23:55.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f78e40019f0 con 0x7f78ec0c52c0 2023-10-14T11:23:55.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 >> v1:172.21.15.67:6789/0 conn(0x7f78ec0c52c0 legacy=0x7f78ec06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78d8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d8004120 0x7f78d8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d8004d90 0x7f78d8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec0d0040 con 0x7f78d8004d90 2023-10-14T11:23:55.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d800baf0 con 0x7f78d8004120 2023-10-14T11:23:55.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d800bcb0 con 0x7f78ec15e4a0 2023-10-14T11:23:55.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d8004d90 0x7f78d8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f1949700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d8004120 0x7f78d8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f214a700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78d8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 -- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 msgr2=0x7f78d8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78ec15e4a0 0x7f78d8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 -- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d8004120 msgr2=0x7f78d8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d8004120 0x7f78d8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.012+0000 7f78f294b700 1 -- 172.21.15.67:0/2708052019 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80035b0 con 0x7f78d8004d90 2023-10-14T11:23:55.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f294b700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d8004d90 0x7f78d8005210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f78e400a7a0 tx=0x7f78d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dbec04e55a8a9c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4012600 con 0x7f78d8004d90 2023-10-14T11:23:55.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4012780 con 0x7f78d8004d90 2023-10-14T11:23:55.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f1148700 1 -- 172.21.15.67:0/2708052019 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4012b30 con 0x7f78d8004d90 2023-10-14T11:23:55.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 -- 172.21.15.67:0/2708052019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d8004d90 msgr2=0x7f78d8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2708052019 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78d8004d90 0x7f78d8005210 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f78e400a7a0 tx=0x7f78d8005880 comp rx=0 tx=0).stop 2023-10-14T11:23:55.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f294b700 1 -- 172.21.15.67:0/2708052019 reap_dead start 2023-10-14T11:23:55.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 -- 172.21.15.67:0/2708052019 shutdown_connections 2023-10-14T11:23:55.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 -- 172.21.15.67:0/2708052019 >> 172.21.15.67:0/2708052019 conn(0x7f78ec0d0440 msgr2=0x7f78ec0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:55.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 -- 172.21.15.67:0/2708052019 shutdown_connections 2023-10-14T11:23:55.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.013+0000 7f78f43ae700 1 -- 172.21.15.67:0/2708052019 wait complete. 2023-10-14T11:23:55.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 Processor -- start 2023-10-14T11:23:55.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 -- start start 2023-10-14T11:23:55.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78d8004d90 0x7f78ec148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78ec14c0c0 0x7f78ec14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec148680 con 0x7f78ec145060 2023-10-14T11:23:55.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec148960 con 0x7f78ec14c0c0 2023-10-14T11:23:55.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f43ae700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec148c40 con 0x7f78d8004d90 2023-10-14T11:23:55.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f1949700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f1949700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43060/0 (socket says 172.21.15.67:43060) 2023-10-14T11:23:55.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.015+0000 7f78f1949700 1 -- 172.21.15.67:0/2202774268 learned_addr learned my addr 172.21.15.67:0/2202774268 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:55.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f214a700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78d8004d90 0x7f78ec148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f294b700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78ec14c0c0 0x7f78ec14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 -- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78d8004d90 msgr2=0x7f78ec148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78d8004d90 0x7f78ec148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 -- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78ec14c0c0 msgr2=0x7f78ec14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78ec14c0c0 0x7f78ec14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 -- 172.21.15.67:0/2202774268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec14b8c0 con 0x7f78ec145060 2023-10-14T11:23:55.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f1949700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78e8011aa0 tx=0x7f78e8011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e8011ed0 con 0x7f78ec145060 2023-10-14T11:23:55.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e800f940 con 0x7f78ec145060 2023-10-14T11:23:55.034 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec14bba0 con 0x7f78ec145060 2023-10-14T11:23:55.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e800fcf0 con 0x7f78ec145060 2023-10-14T11:23:55.035 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.016+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec144700 con 0x7f78ec145060 2023-10-14T11:23:55.036 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.017+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ec14bf10 con 0x7f78ec145060 2023-10-14T11:23:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.018+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78e8014440 con 0x7f78ec145060 2023-10-14T11:23:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.018+0000 7f78e2ffd700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 0x7f78d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.018+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f78e8089ce0 con 0x7f78ec145060 2023-10-14T11:23:55.037 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.018+0000 7f78f214a700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 0x7f78d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.019+0000 7f78f214a700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 0x7f78d006d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78ec1f2360 tx=0x7f78dc0014d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.038 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.023+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78e8054e30 con 0x7f78ec145060 2023-10-14T11:23:55.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.224+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78ec04ebb0 con 0x7f78ec145060 2023-10-14T11:23:55.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.225+0000 7f78e2ffd700 1 -- 172.21.15.67:0/2202774268 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f78e8058450 con 0x7f78ec145060 2023-10-14T11:23:55.229 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:55.229 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":31,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:23:54.251844+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:23:52.391308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:23:53.222815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:55.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 msgr2=0x7f78d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 0x7f78d006d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f78ec1f2360 tx=0x7f78dc0014d0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 msgr2=0x7f78ec1441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f78e8011aa0 tx=0x7f78e8011db0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 shutdown_connections 2023-10-14T11:23:55.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78ec14c0c0 0x7f78ec14a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f78d8004d90 0x7f78ec148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f78d006af00 0x7f78d006d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.232 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 --2- 172.21.15.67:0/2202774268 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f78ec145060 0x7f78ec1441c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.227+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 >> 172.21.15.67:0/2202774268 conn(0x7f78ec0d0440 msgr2=0x7f78ec06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:55.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.228+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 shutdown_connections 2023-10-14T11:23:55.233 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.228+0000 7f78f43ae700 1 -- 172.21.15.67:0/2202774268 wait complete. 2023-10-14T11:23:55.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:55.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.364+0000 7fb7595fb700 1 Processor -- start 2023-10-14T11:23:55.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.364+0000 7fb7595fb700 1 -- start start 2023-10-14T11:23:55.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7595fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 0x7fb7540c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7595fb700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75415de40 con 0x7fb7540c5a10 2023-10-14T11:23:55.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7595fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7541616f0 con 0x7fb75406af90 2023-10-14T11:23:55.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7595fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75406b3f0 con 0x7fb75415da60 2023-10-14T11:23:55.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7527fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb7540c5a10 0x7fb75406a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42360/0 (socket says 172.21.15.67:42360) 2023-10-14T11:23:55.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb7527fc700 1 -- 172.21.15.67:0/2869420891 learned_addr learned my addr 172.21.15.67:0/2869420891 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:55.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb752ffd700 1 --2- 172.21.15.67:0/2869420891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 0x7fb7540c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.365+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579456787 0 0) 0x7fb75415de40 con 0x7fb7540c5a10 2023-10-14T11:23:55.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb73c0035b0 con 0x7fb7540c5a10 2023-10-14T11:23:55.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421344573 0 0) 0x7fb7541616f0 con 0x7fb75406af90 2023-10-14T11:23:55.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb75415de40 con 0x7fb75406af90 2023-10-14T11:23:55.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb752ffd700 1 -- 172.21.15.67:0/2869420891 >> v1:172.21.15.72:6789/0 conn(0x7fb75406af90 legacy=0x7fb754071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb752ffd700 1 -- 172.21.15.67:0/2869420891 >> v1:172.21.15.67:6789/0 conn(0x7fb7540c5a10 legacy=0x7fb75406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb752ffd700 1 -- 172.21.15.67:0/2869420891 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7541619d0 con 0x7fb75415da60 2023-10-14T11:23:55.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb752ffd700 1 --2- 172.21.15.67:0/2869420891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 0x7fb7540c54d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb748009870 tx=0x7fb748009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec746927eb81121 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748011830 con 0x7fb75415da60 2023-10-14T11:23:55.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb748011990 con 0x7fb75415da60 2023-10-14T11:23:55.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.366+0000 7fb751ffb700 1 -- 172.21.15.67:0/2869420891 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748011d00 con 0x7fb75415da60 2023-10-14T11:23:55.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 -- 172.21.15.67:0/2869420891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 msgr2=0x7fb7540c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2869420891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 0x7fb7540c54d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb748009870 tx=0x7fb748009b80 comp rx=0 tx=0).stop 2023-10-14T11:23:55.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 -- 172.21.15.67:0/2869420891 shutdown_connections 2023-10-14T11:23:55.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2869420891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75415da60 0x7fb7540c54d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 -- 172.21.15.67:0/2869420891 >> 172.21.15.67:0/2869420891 conn(0x7fb7540d0440 msgr2=0x7fb7540d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:55.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 -- 172.21.15.67:0/2869420891 shutdown_connections 2023-10-14T11:23:55.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.367+0000 7fb7595fb700 1 -- 172.21.15.67:0/2869420891 wait complete. 2023-10-14T11:23:55.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.368+0000 7fb7595fb700 1 Processor -- start 2023-10-14T11:23:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.368+0000 7fb7595fb700 1 -- start start 2023-10-14T11:23:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75406af90 0x7fb75415e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 0x7fb75415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415e610 con 0x7fb75415da60 2023-10-14T11:23:55.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415e8f0 con 0x7fb7540c5a10 2023-10-14T11:23:55.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7595fb700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75415ebd0 con 0x7fb75406af90 2023-10-14T11:23:55.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43076/0 (socket says 172.21.15.67:43076) 2023-10-14T11:23:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 -- 172.21.15.67:0/2890520891 learned_addr learned my addr 172.21.15.67:0/2890520891 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7527fc700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 0x7fb75415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb752ffd700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75406af90 0x7fb75415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 -- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75406af90 msgr2=0x7fb75415e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75406af90 0x7fb75415e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 -- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 msgr2=0x7fb75415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 0x7fb75415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 -- 172.21.15.67:0/2890520891 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480094a0 con 0x7fb75415da60 2023-10-14T11:23:55.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7527fc700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 0x7fb75415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:55.381 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.369+0000 7fb7537fe700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00cbc0 tx=0x7fb74c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.370+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c003c00 con 0x7fb75415da60 2023-10-14T11:23:55.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.370+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c003d60 con 0x7fb75415da60 2023-10-14T11:23:55.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.370+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75415eeb0 con 0x7fb75415da60 2023-10-14T11:23:55.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.370+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c00ab00 con 0x7fb75415da60 2023-10-14T11:23:55.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.370+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75415fcc0 con 0x7fb75415da60 2023-10-14T11:23:55.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.371+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75414ecd0 con 0x7fb75415da60 2023-10-14T11:23:55.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.371+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb74c00ac60 con 0x7fb75415da60 2023-10-14T11:23:55.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.371+0000 7fb73b7fe700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.372+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb74c089650 con 0x7fb75415da60 2023-10-14T11:23:55.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.372+0000 7fb752ffd700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.372+0000 7fb752ffd700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 0x7fb74006d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7480090b0 tx=0x7fb74801d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.376+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb75414ecd0 con 0x7fb75415da60 2023-10-14T11:23:55.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.578+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb75414ecd0 con 0x7fb75415da60 2023-10-14T11:23:55.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.580+0000 7fb73b7fe700 1 -- 172.21.15.67:0/2890520891 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fb75414ecd0 con 0x7fb75415da60 2023-10-14T11:23:55.583 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:55.583 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":31,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:23:54.251844+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:23:52.391308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:23:53.222815+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:55.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 msgr2=0x7fb74006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 0x7fb74006d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7480090b0 tx=0x7fb74801d040 comp rx=0 tx=0).stop 2023-10-14T11:23:55.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 msgr2=0x7fb754155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb74c00cbc0 tx=0x7fb74c00ced0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 shutdown_connections 2023-10-14T11:23:55.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb74006af00 0x7fb74006d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb75415da60 0x7fb754155e80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb75406af90 0x7fb75415e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 --2- 172.21.15.67:0/2890520891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7540c5a10 0x7fb75415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 >> 172.21.15.67:0/2890520891 conn(0x7fb7540d0440 msgr2=0x7fb7540caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:55.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 shutdown_connections 2023-10-14T11:23:55.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.582+0000 7fb7595fb700 1 -- 172.21.15.67:0/2890520891 wait complete. 2023-10-14T11:23:55.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T11:23:55.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.722+0000 7f373543b700 1 Processor -- start 2023-10-14T11:23:55.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.722+0000 7f373543b700 1 -- start start 2023-10-14T11:23:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f373543b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f37300cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f373543b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f37300d0370 0x7f37300b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f373543b700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37300cce10 con 0x7f373015b990 2023-10-14T11:23:55.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f373543b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37300cc240 con 0x7f37300d0370 2023-10-14T11:23:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f373543b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37300cc4e0 con 0x7f373015bd70 2023-10-14T11:23:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372effd700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f373015b990 0x7f37300b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42374/0 (socket says 172.21.15.67:42374) 2023-10-14T11:23:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372effd700 1 -- 172.21.15.67:0/2365296234 learned_addr learned my addr 172.21.15.67:0/2365296234 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372f7fe700 1 --2- 172.21.15.67:0/2365296234 >> v2:172.21.15.72:3300/0 conn(0x7f37300d0370 0x7f37300b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.730 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372e7fc700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f37300cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242385475 0 0) 0x7f37300cce10 con 0x7f373015b990 2023-10-14T11:23:55.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.723+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37180035b0 con 0x7f373015b990 2023-10-14T11:23:55.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1014243254 0 0) 0x7f37180035b0 con 0x7f373015b990 2023-10-14T11:23:55.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 msgr2=0x7f37300cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.731 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f37300cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 >> v2:172.21.15.72:3300/0 conn(0x7f37300d0370 msgr2=0x7f37300b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 --2- 172.21.15.67:0/2365296234 >> v2:172.21.15.72:3300/0 conn(0x7f37300d0370 0x7f37300b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300cc7c0 con 0x7f373015b990 2023-10-14T11:23:55.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f3724001670 con 0x7f373015b990 2023-10-14T11:23:55.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 >> v1:172.21.15.67:6789/0 conn(0x7f373015b990 legacy=0x7f37300b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3718003a00 0x7f3718003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718004850 0x7f3718004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f3718005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37300cc240 con 0x7f3718003a00 2023-10-14T11:23:55.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37300cc4e0 con 0x7f3718004850 2023-10-14T11:23:55.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371800ba10 con 0x7f373015bd70 2023-10-14T11:23:55.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372f7fe700 1 --2- 172.21.15.67:0/2365296234 >> v2:172.21.15.72:3300/0 conn(0x7f37300d0370 0x7f37300b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:55.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3718003a00 0x7f3718003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372e7fc700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718004850 0x7f3718004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372f7fe700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f3718005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 -- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 msgr2=0x7f3718005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f373015bd70 0x7f3718005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 -- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718004850 msgr2=0x7f3718004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:55.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718004850 0x7f3718004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 -- 172.21.15.67:0/2365296234 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180035b0 con 0x7f3718003a00 2023-10-14T11:23:55.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.724+0000 7f372effd700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3718003a00 0x7f3718003e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3724012a00 tx=0x7f3718005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b9b10a194696f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724017070 con 0x7f3718003a00 2023-10-14T11:23:55.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3724005960 con 0x7f3718003a00 2023-10-14T11:23:55.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f372dffb700 1 -- 172.21.15.67:0/2365296234 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3724005d10 con 0x7f3718003a00 2023-10-14T11:23:55.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 -- 172.21.15.67:0/2365296234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3718003a00 msgr2=0x7f3718003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 --2- 172.21.15.67:0/2365296234 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3718003a00 0x7f3718003e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3724012a00 tx=0x7f3718005880 comp rx=0 tx=0).stop 2023-10-14T11:23:55.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f372f7fe700 1 -- 172.21.15.67:0/2365296234 reap_dead start 2023-10-14T11:23:55.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 -- 172.21.15.67:0/2365296234 shutdown_connections 2023-10-14T11:23:55.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 -- 172.21.15.67:0/2365296234 >> 172.21.15.67:0/2365296234 conn(0x7f37300d1580 msgr2=0x7f37300d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:55.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 -- 172.21.15.67:0/2365296234 shutdown_connections 2023-10-14T11:23:55.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.725+0000 7f373543b700 1 -- 172.21.15.67:0/2365296234 wait complete. 2023-10-14T11:23:55.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 Processor -- start 2023-10-14T11:23:55.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 -- start start 2023-10-14T11:23:55.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718003a00 0x7f37300b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.743 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3730150c30 0x7f373006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37300b5a90 con 0x7f37301eee70 2023-10-14T11:23:55.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730153400 con 0x7f3718003a00 2023-10-14T11:23:55.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f373543b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37300b54d0 con 0x7f3730150c30 2023-10-14T11:23:55.744 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.727+0000 7f372e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43094/0 (socket says 172.21.15.67:43094) 2023-10-14T11:23:55.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 -- 172.21.15.67:0/3102333860 learned_addr learned my addr 172.21.15.67:0/3102333860 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:55.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372effd700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718003a00 0x7f37300b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372f7fe700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3730150c30 0x7f373006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 -- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3730150c30 msgr2=0x7f373006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3730150c30 0x7f373006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 -- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718003a00 msgr2=0x7f37300b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718003a00 0x7f37300b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 -- 172.21.15.67:0/3102333860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300b57b0 con 0x7f37301eee70 2023-10-14T11:23:55.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f372e7fc700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37200119a0 tx=0x7f3720011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000f780 con 0x7f37301eee70 2023-10-14T11:23:55.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372000f8e0 con 0x7f37301eee70 2023-10-14T11:23:55.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3730153bd0 con 0x7f37301eee70 2023-10-14T11:23:55.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372000fc70 con 0x7f37301eee70 2023-10-14T11:23:55.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.728+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37301510e0 con 0x7f37301eee70 2023-10-14T11:23:55.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.729+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3730153a30 con 0x7f37301eee70 2023-10-14T11:23:55.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.730+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3720014440 con 0x7f37301eee70 2023-10-14T11:23:55.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.730+0000 7f37177fe700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 0x7f371c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:55.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.730+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3720089c40 con 0x7f37301eee70 2023-10-14T11:23:55.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.730+0000 7f372effd700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 0x7f371c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:55.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.731+0000 7f372effd700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 0x7f371c06d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3724012a00 tx=0x7f3724018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:55.749 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.735+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3730153a30 con 0x7f37301eee70 2023-10-14T11:23:55.992 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:55.989+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3730153a30 con 0x7f37301eee70 2023-10-14T11:23:56.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.853+0000 7f37177fe700 1 -- 172.21.15.67:0/3102333860 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3730153a30 con 0x7f37301eee70 2023-10-14T11:23:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 msgr2=0x7f371c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 0x7f371c06d3c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3724012a00 tx=0x7f3724018000 comp rx=0 tx=0).stop 2023-10-14T11:23:56.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 msgr2=0x7f3730152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37200119a0 tx=0x7f3720011cb0 comp rx=0 tx=0).stop 2023-10-14T11:23:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 shutdown_connections 2023-10-14T11:23:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3730150c30 0x7f373006c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3718003a00 0x7f37300b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:56.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f371c06af00 0x7f371c06d3c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:56.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 --2- 172.21.15.67:0/3102333860 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f37301eee70 0x7f3730152ec0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:56.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 >> 172.21.15.67:0/3102333860 conn(0x7f37300d1580 msgr2=0x7f37300cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:56.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 shutdown_connections 2023-10-14T11:23:56.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:56.856+0000 7f373543b700 1 -- 172.21.15.67:0/3102333860 wait complete. 2023-10-14T11:23:56.874 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T11:23:56.875 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T11:23:57.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.009+0000 7f422f2f4700 1 Processor -- start 2023-10-14T11:23:57.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.009+0000 7f422f2f4700 1 -- start start 2023-10-14T11:23:57.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.010+0000 7f422f2f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42280ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.010+0000 7f422f2f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.010+0000 7f422f2f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280ad3c0 con 0x7f422815aa60 2023-10-14T11:23:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.010+0000 7f422f2f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280d1300 con 0x7f422815ae40 2023-10-14T11:23:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.010+0000 7f422f2f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280ce8f0 con 0x7f42280cd0d0 2023-10-14T11:23:57.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422d891700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422d891700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:43512/0 (socket says 172.21.15.67:43512) 2023-10-14T11:23:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422d891700 1 -- 172.21.15.67:0/2437106622 learned_addr learned my addr 172.21.15.67:0/2437106622 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 --2- 172.21.15.67:0/2437106622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42280ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 -- 172.21.15.67:0/2437106622 >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 msgr2=0x7f42280cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:57.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 --2- 172.21.15.67:0/2437106622 >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 -- 172.21.15.67:0/2437106622 >> v1:172.21.15.72:6789/0 conn(0x7f422815aa60 legacy=0x7f42280cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 -- 172.21.15.67:0/2437106622 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42280ceb50 con 0x7f42280cd0d0 2023-10-14T11:23:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422d891700 1 --2- 172.21.15.67:0/2437106622 >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:23:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f422c88f700 1 --2- 172.21.15.67:0/2437106622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42280ce3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4224009840 tx=0x7f4224009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6734ebfbebd70b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:57.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.011+0000 7f421ffff700 1 -- 172.21.15.67:0/2437106622 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224011830 con 0x7f42280cd0d0 2023-10-14T11:23:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f421ffff700 1 -- 172.21.15.67:0/2437106622 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224011990 con 0x7f42280cd0d0 2023-10-14T11:23:57.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f421ffff700 1 -- 172.21.15.67:0/2437106622 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224011d20 con 0x7f42280cd0d0 2023-10-14T11:23:57.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 -- 172.21.15.67:0/2437106622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 msgr2=0x7f42280ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 --2- 172.21.15.67:0/2437106622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42280ce3b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4224009840 tx=0x7f4224009b50 comp rx=0 tx=0).stop 2023-10-14T11:23:57.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 -- 172.21.15.67:0/2437106622 shutdown_connections 2023-10-14T11:23:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 --2- 172.21.15.67:0/2437106622 >> v2:172.21.15.72:3300/0 conn(0x7f422815ae40 0x7f42280cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 --2- 172.21.15.67:0/2437106622 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42280ce3b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 -- 172.21.15.67:0/2437106622 >> 172.21.15.67:0/2437106622 conn(0x7f42280d04b0 msgr2=0x7f42280d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 -- 172.21.15.67:0/2437106622 shutdown_connections 2023-10-14T11:23:57.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.012+0000 7f422f2f4700 1 -- 172.21.15.67:0/2437106622 wait complete. 2023-10-14T11:23:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.013+0000 7f422f2f4700 1 Processor -- start 2023-10-14T11:23:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.013+0000 7f422f2f4700 1 -- start start 2023-10-14T11:23:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42281434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f422815aa60 0x7f4228143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281576b0 con 0x7f422815ae40 2023-10-14T11:23:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281443c0 con 0x7f422815aa60 2023-10-14T11:23:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422f2f4700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42281570f0 con 0x7f42280cd0d0 2023-10-14T11:23:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422d891700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422d891700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43110/0 (socket says 172.21.15.67:43110) 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422d891700 1 -- 172.21.15.67:0/3782759257 learned_addr learned my addr 172.21.15.67:0/3782759257 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422d090700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42281434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.014+0000 7f422c88f700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f422815aa60 0x7f4228143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 -- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 msgr2=0x7f42281434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42281434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 -- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f422815aa60 msgr2=0x7f4228143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f422815aa60 0x7f4228143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 -- 172.21.15.67:0/3782759257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422000bd40 con 0x7f422815ae40 2023-10-14T11:23:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422d891700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f422000e0c0 tx=0x7f422000e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:57.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220003a20 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220010030 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42240094a0 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220003da0 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.015+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280c8470 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.016+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42280c82d0 con 0x7f422815ae40 2023-10-14T11:23:57.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.016+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f422000e9d0 con 0x7f422815ae40 2023-10-14T11:23:57.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.017+0000 7f421dffb700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 0x7f420c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:57.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.017+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f422008bb10 con 0x7f422815ae40 2023-10-14T11:23:57.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.017+0000 7f422d090700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 0x7f420c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:57.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.017+0000 7f422d090700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 0x7f420c06d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4218007fd0 tx=0x7f4218009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:57.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.021+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42280c82d0 con 0x7f422815ae40 2023-10-14T11:23:57.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.268+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42280c82d0 con 0x7f422815ae40 2023-10-14T11:23:57.803 INFO:tasks.ceph.mds.a.smithi067.stderr:2023-10-14T11:23:57.800+0000 7f461a6ab700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T11:23:57.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.854+0000 7f421dffb700 1 -- 172.21.15.67:0/3782759257 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 127+0+0 (secure 0 0 0) 0x7f42280c82d0 con 0x7f422815ae40 2023-10-14T11:23:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 msgr2=0x7f420c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 0x7f420c06d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4218007fd0 tx=0x7f4218009040 comp rx=0 tx=0).stop 2023-10-14T11:23:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 msgr2=0x7f42281ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f422000e0c0 tx=0x7f422000e3d0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 shutdown_connections 2023-10-14T11:23:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f420c06af00 0x7f420c06d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f422815ae40 0x7f42281ee4a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f42280cd0d0 0x7f42281434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 --2- 172.21.15.67:0/3782759257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f422815aa60 0x7f4228143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 >> 172.21.15.67:0/3782759257 conn(0x7f42280d04b0 msgr2=0x7f422806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 shutdown_connections 2023-10-14T11:23:57.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:57.857+0000 7f422f2f4700 1 -- 172.21.15.67:0/3782759257 wait complete. 2023-10-14T11:23:57.875 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T11:23:57.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:23:58.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.004+0000 7fdd10592700 1 Processor -- start 2023-10-14T11:23:58.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.004+0000 7fdd10592700 1 -- start start 2023-10-14T11:23:58.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd10592700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd081593e0 0x7fdd0815c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd10592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdd080ca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd10592700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0806e2b0 con 0x7fdd08159000 2023-10-14T11:23:58.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd10592700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080cab80 con 0x7fdd081593e0 2023-10-14T11:23:58.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd10592700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0806d730 con 0x7fdd080ca1c0 2023-10-14T11:23:58.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd0e32e700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fdd08159000 0x7fdd0806cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42408/0 (socket says 172.21.15.67:42408) 2023-10-14T11:23:58.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.005+0000 7fdd0e32e700 1 -- 172.21.15.67:0/2995980333 learned_addr learned my addr 172.21.15.67:0/2995980333 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:58.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/2995980333 >> v2:172.21.15.72:3300/0 conn(0x7fdd081593e0 0x7fdd0815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0eb2f700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdd080ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652587767 0 0) 0x7fdd0806e2b0 con 0x7fdd08159000 2023-10-14T11:23:58.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf40035b0 con 0x7fdd08159000 2023-10-14T11:23:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910446029 0 0) 0x7fdcf40035b0 con 0x7fdd08159000 2023-10-14T11:23:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 msgr2=0x7fdd080ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdd080ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 >> v2:172.21.15.72:3300/0 conn(0x7fdd081593e0 msgr2=0x7fdd0815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 --2- 172.21.15.67:0/2995980333 >> v2:172.21.15.72:3300/0 conn(0x7fdd081593e0 0x7fdd0815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0806da10 con 0x7fdd08159000 2023-10-14T11:23:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7fdd04001670 con 0x7fdd08159000 2023-10-14T11:23:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 >> v1:172.21.15.67:6789/0 conn(0x7fdd08159000 legacy=0x7fdd0806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdcf4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdcf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf4004d90 0x7fdcf4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080cab80 con 0x7fdcf4003f80 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0806d730 con 0x7fdcf4004d90 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf400ba60 con 0x7fdd080ca1c0 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdcf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0e32e700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdcf4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.006+0000 7fdd0eb2f700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf4004d90 0x7fdcf4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 -- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 msgr2=0x7fdcf4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080ca1c0 0x7fdcf4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 -- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf4004d90 msgr2=0x7fdcf4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdcf4004d90 0x7fdcf4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 -- 172.21.15.67:0/2995980333 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40035b0 con 0x7fdcf4003f80 2023-10-14T11:23:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdcf4004850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009b60 tx=0x7fdcf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c93c1c87f0a9e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800e6c0 con 0x7fdcf4003f80 2023-10-14T11:23:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf800e820 con 0x7fdcf4003f80 2023-10-14T11:23:58.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0d32c700 1 -- 172.21.15.67:0/2995980333 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800eb90 con 0x7fdcf4003f80 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd10592700 1 -- 172.21.15.67:0/2995980333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 msgr2=0x7fdcf4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd10592700 1 --2- 172.21.15.67:0/2995980333 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdcf4004850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009b60 tx=0x7fdcf4005880 comp rx=0 tx=0).stop 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.007+0000 7fdd0eb2f700 1 -- 172.21.15.67:0/2995980333 reap_dead start 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.008+0000 7fdd10592700 1 -- 172.21.15.67:0/2995980333 shutdown_connections 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.008+0000 7fdd10592700 1 -- 172.21.15.67:0/2995980333 >> 172.21.15.67:0/2995980333 conn(0x7fdd080b16f0 msgr2=0x7fdd080b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.008+0000 7fdd10592700 1 -- 172.21.15.67:0/2995980333 shutdown_connections 2023-10-14T11:23:58.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.008+0000 7fdd10592700 1 -- 172.21.15.67:0/2995980333 wait complete. 2023-10-14T11:23:58.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.009+0000 7fdd10592700 1 Processor -- start 2023-10-14T11:23:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.009+0000 7fdd10592700 1 -- start start 2023-10-14T11:23:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 0x7fdd0806aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080c9a50 0x7fdd0806afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08155370 con 0x7fdcf4003f80 2023-10-14T11:23:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0815d1e0 con 0x7fdd080c95d0 2023-10-14T11:23:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd10592700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0815d4c0 con 0x7fdd080c9a50 2023-10-14T11:23:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd0e32e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd0e32e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43126/0 (socket says 172.21.15.67:43126) 2023-10-14T11:23:58.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.010+0000 7fdd0e32e700 1 -- 172.21.15.67:0/1539236364 learned_addr learned my addr 172.21.15.67:0/1539236364 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0eb2f700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080c9a50 0x7fdd0806afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 0x7fdd0806aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 -- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080c9a50 msgr2=0x7fdd0806afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080c9a50 0x7fdd0806afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 -- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 msgr2=0x7fdd0806aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 0x7fdd0806aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 -- 172.21.15.67:0/1539236364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0815d7a0 con 0x7fdcf4003f80 2023-10-14T11:23:58.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 0x7fdd0806aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:58.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd0e32e700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000fb0 tx=0x7fdd040075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400f600 con 0x7fdcf4003f80 2023-10-14T11:23:58.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400f760 con 0x7fdcf4003f80 2023-10-14T11:23:58.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0815da80 con 0x7fdcf4003f80 2023-10-14T11:23:58.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400fb10 con 0x7fdcf4003f80 2023-10-14T11:23:58.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.011+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd080c36a0 con 0x7fdcf4003f80 2023-10-14T11:23:58.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.012+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd080c3830 con 0x7fdcf4003f80 2023-10-14T11:23:58.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.013+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd0400fc70 con 0x7fdcf4003f80 2023-10-14T11:23:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.013+0000 7fdcfeffd700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 0x7fdcec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.013+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fdd04089510 con 0x7fdcf4003f80 2023-10-14T11:23:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.013+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 0x7fdcec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.014+0000 7fdd0db2d700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 0x7fdcec06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80090b0 tx=0x7fdcf801e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.018+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdd080c3830 con 0x7fdcf4003f80 2023-10-14T11:23:58.268 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.265+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd080c3830 con 0x7fdcf4003f80 2023-10-14T11:23:58.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.266+0000 7fdcfeffd700 1 -- 172.21.15.67:0/1539236364 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fdd080c3830 con 0x7fdcf4003f80 2023-10-14T11:23:58.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:58.269 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1587797003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1587797003},{"type":"v1","addr":"172.21.15.72:6837","nonce":1587797003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3653699709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3653699709},{"type":"v1","addr":"172.21.15.67:6835","nonce":3653699709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3108239461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3108239461},{"type":"v1","addr":"172.21.15.72:6836","nonce":3108239461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:23:54.252164+0000","modified":"2023-10-14T11:23:57.270421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/2432149351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2432149351},{"type":"v1","addr":"172.21.15.67:6834","nonce":2432149351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:23:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 msgr2=0x7fdcec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 0x7fdcec06d3c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80090b0 tx=0x7fdcf801e040 comp rx=0 tx=0).stop 2023-10-14T11:23:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 msgr2=0x7fdd08154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000fb0 tx=0x7fdd040075f0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 shutdown_connections 2023-10-14T11:23:58.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fdd080c9a50 0x7fdd0806afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fdcec06af00 0x7fdcec06d3c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fdcf4003f80 0x7fdd08154e30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 --2- 172.21.15.67:0/1539236364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd080c95d0 0x7fdd0806aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 >> 172.21.15.67:0/1539236364 conn(0x7fdd080b16f0 msgr2=0x7fdd080cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 shutdown_connections 2023-10-14T11:23:58.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.268+0000 7fdd10592700 1 -- 172.21.15.67:0/1539236364 wait complete. 2023-10-14T11:23:58.274 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2023-10-14T11:23:58.283 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:23:58.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.405+0000 7f07edbfa700 1 Processor -- start 2023-10-14T11:23:58.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.405+0000 7f07edbfa700 1 -- start start 2023-10-14T11:23:58.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07edbfa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07e815def0 0x7f07e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07edbfa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07edbfa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e806cdd0 con 0x7f07e81618d0 2023-10-14T11:23:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07edbfa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e806c1c0 con 0x7f07e815def0 2023-10-14T11:23:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07edbfa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e806c4a0 con 0x7f07e80cfe80 2023-10-14T11:23:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e77fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07e815def0 0x7f07e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:45406/0 (socket says 172.21.15.67:45406) 2023-10-14T11:23:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 -- 172.21.15.67:0/635418680 learned_addr learned my addr 172.21.15.67:0/635418680 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 -- 172.21.15.67:0/635418680 >> v2:172.21.15.72:3300/0 conn(0x7f07e815def0 msgr2=0x7f07e806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/635418680 >> v2:172.21.15.72:3300/0 conn(0x7f07e815def0 0x7f07e806d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 -- 172.21.15.67:0/635418680 >> v1:172.21.15.72:6789/0 conn(0x7f07e81618d0 legacy=0x7f07e815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.406+0000 7f07e6ffd700 1 -- 172.21.15.67:0/635418680 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e806c780 con 0x7f07e80cfe80 2023-10-14T11:23:58.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/635418680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0098f0 tx=0x7f07dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1ccc3f8ed7c78ab server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07e67fc700 1 -- 172.21.15.67:0/635418680 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011830 con 0x7f07e80cfe80 2023-10-14T11:23:58.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07e67fc700 1 -- 172.21.15.67:0/635418680 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc011990 con 0x7f07e80cfe80 2023-10-14T11:23:58.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07e67fc700 1 -- 172.21.15.67:0/635418680 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc011d20 con 0x7f07e80cfe80 2023-10-14T11:23:58.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 -- 172.21.15.67:0/635418680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 msgr2=0x7f07e80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 --2- 172.21.15.67:0/635418680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0098f0 tx=0x7f07dc009c00 comp rx=0 tx=0).stop 2023-10-14T11:23:58.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 -- 172.21.15.67:0/635418680 shutdown_connections 2023-10-14T11:23:58.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 --2- 172.21.15.67:0/635418680 >> v2:172.21.15.72:3300/0 conn(0x7f07e815def0 0x7f07e806d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 --2- 172.21.15.67:0/635418680 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e80cfe80 0x7f07e80d0300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 -- 172.21.15.67:0/635418680 >> 172.21.15.67:0/635418680 conn(0x7f07e80d1570 msgr2=0x7f07e80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 -- 172.21.15.67:0/635418680 shutdown_connections 2023-10-14T11:23:58.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.407+0000 7f07edbfa700 1 -- 172.21.15.67:0/635418680 wait complete. 2023-10-14T11:23:58.418 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 Processor -- start 2023-10-14T11:23:58.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 -- start start 2023-10-14T11:23:58.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.419 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 0x7f07e80c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 0x7f07e80c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b22e0 con 0x7f07e80cfe80 2023-10-14T11:23:58.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b25c0 con 0x7f07e81618d0 2023-10-14T11:23:58.420 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.409+0000 7f07edbfa700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80b28a0 con 0x7f07e815def0 2023-10-14T11:23:58.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43140/0 (socket says 172.21.15.67:43140) 2023-10-14T11:23:58.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 -- 172.21.15.67:0/452947146 learned_addr learned my addr 172.21.15.67:0/452947146 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:58.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 0x7f07e80c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.421 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e7fff700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 0x7f07e80c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 -- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 msgr2=0x7f07e80c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 0x7f07e80c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 -- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 msgr2=0x7f07e80c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 0x7f07e80c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.422 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 -- 172.21.15.67:0/452947146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009550 con 0x7f07e80cfe80 2023-10-14T11:23:58.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 0x7f07e80c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:58.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e7fff700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 0x7f07e80c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:23:58.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07e77fe700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9b0 tx=0x7f07d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8009710 con 0x7f07e80cfe80 2023-10-14T11:23:58.423 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800c850 con 0x7f07e80cfe80 2023-10-14T11:23:58.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e80b2b80 con 0x7f07e80cfe80 2023-10-14T11:23:58.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800cbc0 con 0x7f07e80cfe80 2023-10-14T11:23:58.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.410+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80b3380 con 0x7f07e80cfe80 2023-10-14T11:23:58.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.411+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80b31d0 con 0x7f07e80cfe80 2023-10-14T11:23:58.424 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.412+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f07d800cd20 con 0x7f07e80cfe80 2023-10-14T11:23:58.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.412+0000 7f07cffff700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.412+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f07d8089660 con 0x7f07e80cfe80 2023-10-14T11:23:58.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.412+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.425 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.413+0000 7f07e6ffd700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 0x7f07d406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009840 tx=0x7f07dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.426 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.417+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07d8054780 con 0x7f07e80cfe80 2023-10-14T11:23:58.619 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.617+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e806ca30 con 0x7f07e80cfe80 2023-10-14T11:23:58.622 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.618+0000 7f07cffff700 1 -- 172.21.15.67:0/452947146 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f07d8057da0 con 0x7f07e80cfe80 2023-10-14T11:23:58.622 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:58.623 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:23:55.843760+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:23:52.391308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:23:53.222815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:23:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 msgr2=0x7f07d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 0x7f07d406d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009840 tx=0x7f07dc008030 comp rx=0 tx=0).stop 2023-10-14T11:23:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 msgr2=0x7f07e80b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.624 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07d800e9b0 tx=0x7f07d800ed70 comp rx=0 tx=0).stop 2023-10-14T11:23:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 shutdown_connections 2023-10-14T11:23:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07e81618d0 0x7f07e80c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07e80cfe80 0x7f07e80b1d00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.625 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 --2- 172.21.15.67:0/452947146 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f07e815def0 0x7f07e80c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 >> 172.21.15.67:0/452947146 conn(0x7f07e80d1570 msgr2=0x7f07e80b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 shutdown_connections 2023-10-14T11:23:58.626 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.620+0000 7f07edbfa700 1 -- 172.21.15.67:0/452947146 wait complete. 2023-10-14T11:23:58.635 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T11:23:58.636 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:58.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.757+0000 7f675e7be700 1 Processor -- start 2023-10-14T11:23:58.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.757+0000 7f675e7be700 1 -- start start 2023-10-14T11:23:58.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675e7be700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f67580c5be0 0x7f675806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675e7be700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f675806adc0 0x7f6758071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675e7be700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675815de40 con 0x7f675815da60 2023-10-14T11:23:58.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675e7be700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67581624b0 con 0x7f675806adc0 2023-10-14T11:23:58.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675e7be700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67581616f0 con 0x7f67580c5be0 2023-10-14T11:23:58.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f675806adc0 0x7f6758071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f6757fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f675815da60 0x7f67580c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42442/0 (socket says 172.21.15.67:42442) 2023-10-14T11:23:58.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f675806adc0 0x7f6758071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43152/0 (socket says 172.21.15.67:43152) 2023-10-14T11:23:58.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f6757fff700 1 -- 172.21.15.67:0/3516763874 learned_addr learned my addr 172.21.15.67:0/3516763874 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:58.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f67577fe700 1 --2- 172.21.15.67:0/3516763874 >> v2:172.21.15.72:3300/0 conn(0x7f67580c5be0 0x7f675806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.765 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 -- 172.21.15.67:0/3516763874 >> v2:172.21.15.72:3300/0 conn(0x7f67580c5be0 msgr2=0x7f675806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:58.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 --2- 172.21.15.67:0/3516763874 >> v2:172.21.15.72:3300/0 conn(0x7f67580c5be0 0x7f675806a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 -- 172.21.15.67:0/3516763874 >> v1:172.21.15.67:6789/0 conn(0x7f675815da60 legacy=0x7f67580c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 -- 172.21.15.67:0/3516763874 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67581619d0 con 0x7f675806adc0 2023-10-14T11:23:58.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f6756ffd700 1 -- 172.21.15.67:0/3516763874 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466553595 0 0) 0x7f675815de40 con 0x7f675815da60 2023-10-14T11:23:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f675cd5b700 1 --2- 172.21.15.67:0/3516763874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f6758071be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67580afab0 tx=0x7f675000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d90b09ed66c918 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.758+0000 7f6756ffd700 1 -- 172.21.15.67:0/3516763874 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675000e070 con 0x7f675806adc0 2023-10-14T11:23:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f6756ffd700 1 -- 172.21.15.67:0/3516763874 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675000bb20 con 0x7f675806adc0 2023-10-14T11:23:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f6756ffd700 1 -- 172.21.15.67:0/3516763874 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750012430 con 0x7f675806adc0 2023-10-14T11:23:58.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 -- 172.21.15.67:0/3516763874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 msgr2=0x7f6758071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 --2- 172.21.15.67:0/3516763874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f6758071be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67580afab0 tx=0x7f675000b330 comp rx=0 tx=0).stop 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 -- 172.21.15.67:0/3516763874 shutdown_connections 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 --2- 172.21.15.67:0/3516763874 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f6758071be0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 --2- 172.21.15.67:0/3516763874 >> v2:172.21.15.72:3300/0 conn(0x7f67580c5be0 0x7f675806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 -- 172.21.15.67:0/3516763874 >> 172.21.15.67:0/3516763874 conn(0x7f67580d0440 msgr2=0x7f67580d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 -- 172.21.15.67:0/3516763874 shutdown_connections 2023-10-14T11:23:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.759+0000 7f675e7be700 1 -- 172.21.15.67:0/3516763874 wait complete. 2023-10-14T11:23:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.760+0000 7f675e7be700 1 Processor -- start 2023-10-14T11:23:58.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 -- start start 2023-10-14T11:23:58.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 0x7f67581f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f675815da60 0x7f675815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67581f6f50 con 0x7f675806adc0 2023-10-14T11:23:58.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67580aff60 con 0x7f67580c5be0 2023-10-14T11:23:58.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f675e7be700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67580b0240 con 0x7f675815da60 2023-10-14T11:23:58.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f6757fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f6757fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43154/0 (socket says 172.21.15.67:43154) 2023-10-14T11:23:58.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.761+0000 7f6757fff700 1 -- 172.21.15.67:0/975442026 learned_addr learned my addr 172.21.15.67:0/975442026 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:58.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f67577fe700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 0x7f67581f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f675cd5b700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f675815da60 0x7f675815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 -- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f675815da60 msgr2=0x7f675815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f675815da60 0x7f675815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 -- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 msgr2=0x7f67581f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 0x7f67581f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 -- 172.21.15.67:0/975442026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009a70 con 0x7f675806adc0 2023-10-14T11:23:58.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f67577fe700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 0x7f67581f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:23:58.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6757fff700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67480011e0 tx=0x7f674800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748004c80 con 0x7f675806adc0 2023-10-14T11:23:58.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748004e00 con 0x7f675806adc0 2023-10-14T11:23:58.777 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67580b5810 con 0x7f675806adc0 2023-10-14T11:23:58.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748007310 con 0x7f675806adc0 2023-10-14T11:23:58.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.762+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67580b0520 con 0x7f675806adc0 2023-10-14T11:23:58.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.763+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67580744e0 con 0x7f675806adc0 2023-10-14T11:23:58.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.763+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6748007470 con 0x7f675806adc0 2023-10-14T11:23:58.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.764+0000 7f6754ff9700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 0x7f674406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:58.779 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.764+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6748089310 con 0x7f675806adc0 2023-10-14T11:23:58.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.764+0000 7f67577fe700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 0x7f674406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:58.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.764+0000 7f67577fe700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 0x7f674406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67581f5f60 tx=0x7f674c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:58.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.768+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6748054430 con 0x7f675806adc0 2023-10-14T11:23:58.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.969+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6758161cb0 con 0x7f674406af00 2023-10-14T11:23:58.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.978+0000 7f6754ff9700 1 -- 172.21.15.67:0/975442026 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289124 (secure 0 0 0) 0x7f674c0106b0 con 0x7f674406af00 2023-10-14T11:23:58.985 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 msgr2=0x7f674406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 0x7f674406d3c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67581f5f60 tx=0x7f674c008040 comp rx=0 tx=0).stop 2023-10-14T11:23:58.987 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 msgr2=0x7f675815e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:58.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f67480011e0 tx=0x7f674800cae0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 shutdown_connections 2023-10-14T11:23:58.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f675815da60 0x7f675815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.988 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f674406af00 0x7f674406d3c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f675806adc0 0x7f675815e030 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 --2- 172.21.15.67:0/975442026 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67580c5be0 0x7f67581f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:58.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 >> 172.21.15.67:0/975442026 conn(0x7f67580d0440 msgr2=0x7f6758157310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:58.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 shutdown_connections 2023-10-14T11:23:58.989 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:58.982+0000 7f675e7be700 1 -- 172.21.15.67:0/975442026 wait complete. 2023-10-14T11:23:58.990 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:58.997 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T11:23:58.415876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4063232,"data_stored":2258334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.592172"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873757+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:54.873757+0000","last_peered":"2023-10-14T11:23:54.873757+0000","last_clean":"2023-10-14T11:23:54.873757+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:54.873757+0000","last_undegraded":"2023-10-14T11:23:54.873757+0000","last_fullsized":"2023-10-14T11:23:54.873757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868618+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:54.868618+0000","last_peered":"2023-10-14T11:23:54.868618+0000","last_clean":"2023-10-14T11:23:54.868618+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:54.868618+0000","last_undegraded":"2023-10-14T11:23:54.868618+0000","last_fullsized":"2023-10-14T11:23:54.868618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866213+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:54.866213+0000","last_peered":"2023-10-14T11:23:54.866213+0000","last_clean":"2023-10-14T11:23:54.866213+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:54.866213+0000","last_undegraded":"2023-10-14T11:23:54.866213+0000","last_fullsized":"2023-10-14T11:23:54.866213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863225+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:54.863225+0000","last_peered":"2023-10-14T11:23:54.863225+0000","last_clean":"2023-10-14T11:23:54.863225+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:54.863225+0000","last_undegraded":"2023-10-14T11:23:54.863225+0000","last_fullsized":"2023-10-14T11:23:54.863225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868694+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:54.868694+0000","last_peered":"2023-10-14T11:23:54.868694+0000","last_clean":"2023-10-14T11:23:54.868694+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:54.868694+0000","last_undegraded":"2023-10-14T11:23:54.868694+0000","last_fullsized":"2023-10-14T11:23:54.868694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863518+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:54.863518+0000","last_peered":"2023-10-14T11:23:54.863518+0000","last_clean":"2023-10-14T11:23:54.863518+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:54.863518+0000","last_undegraded":"2023-10-14T11:23:54.863518+0000","last_fullsized":"2023-10-14T11:23:54.863518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863439+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:54.863439+0000","last_peered":"2023-10-14T11:23:54.863439+0000","last_clean":"2023-10-14T11:23:54.863439+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:54.863439+0000","last_undegraded":"2023-10-14T11:23:54.863439+0000","last_fullsized":"2023-10-14T11:23:54.863439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865982+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:54.865982+0000","last_peered":"2023-10-14T11:23:54.865982+0000","last_clean":"2023-10-14T11:23:54.865982+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:54.865982+0000","last_undegraded":"2023-10-14T11:23:54.865982+0000","last_fullsized":"2023-10-14T11:23:54.865982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866075+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:54.866075+0000","last_peered":"2023-10-14T11:23:54.866075+0000","last_clean":"2023-10-14T11:23:54.866075+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:54.866075+0000","last_undegraded":"2023-10-14T11:23:54.866075+0000","last_fullsized":"2023-10-14T11:23:54.866075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865764+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:54.865764+0000","last_peered":"2023-10-14T11:23:54.865764+0000","last_clean":"2023-10-14T11:23:54.865764+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:54.865764+0000","last_undegraded":"2023-10-14T11:23:54.865764+0000","last_fullsized":"2023-10-14T11:23:54.865764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863894+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:54.863894+0000","last_peered":"2023-10-14T11:23:54.863894+0000","last_clean":"2023-10-14T11:23:54.863894+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:54.863894+0000","last_undegraded":"2023-10-14T11:23:54.863894+0000","last_fullsized":"2023-10-14T11:23:54.863894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:04.778293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859682+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:54.859682+0000","last_peered":"2023-10-14T11:23:54.859682+0000","last_clean":"2023-10-14T11:23:54.859682+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:54.859682+0000","last_undegraded":"2023-10-14T11:23:54.859682+0000","last_fullsized":"2023-10-14T11:23:54.859682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863684+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:54.863684+0000","last_peered":"2023-10-14T11:23:54.863684+0000","last_clean":"2023-10-14T11:23:54.863684+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:54.863684+0000","last_undegraded":"2023-10-14T11:23:54.863684+0000","last_fullsized":"2023-10-14T11:23:54.863684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.861588+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:54.861588+0000","last_peered":"2023-10-14T11:23:54.861588+0000","last_clean":"2023-10-14T11:23:54.861588+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:54.861588+0000","last_undegraded":"2023-10-14T11:23:54.861588+0000","last_fullsized":"2023-10-14T11:23:54.861588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.860863+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:54.860863+0000","last_peered":"2023-10-14T11:23:54.860863+0000","last_clean":"2023-10-14T11:23:54.860863+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:54.860863+0000","last_undegraded":"2023-10-14T11:23:54.860863+0000","last_fullsized":"2023-10-14T11:23:54.860863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866077+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:54.866077+0000","last_peered":"2023-10-14T11:23:54.866077+0000","last_clean":"2023-10-14T11:23:54.866077+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:54.866077+0000","last_undegraded":"2023-10-14T11:23:54.866077+0000","last_fullsized":"2023-10-14T11:23:54.866077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866193+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:54.866193+0000","last_peered":"2023-10-14T11:23:54.866193+0000","last_clean":"2023-10-14T11:23:54.866193+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:54.866193+0000","last_undegraded":"2023-10-14T11:23:54.866193+0000","last_fullsized":"2023-10-14T11:23:54.866193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859742+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:54.859742+0000","last_peered":"2023-10-14T11:23:54.859742+0000","last_clean":"2023-10-14T11:23:54.859742+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:54.859742+0000","last_undegraded":"2023-10-14T11:23:54.859742+0000","last_fullsized":"2023-10-14T11:23:54.859742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868811+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:54.868811+0000","last_peered":"2023-10-14T11:23:54.868811+0000","last_clean":"2023-10-14T11:23:54.868811+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:54.868811+0000","last_undegraded":"2023-10-14T11:23:54.868811+0000","last_fullsized":"2023-10-14T11:23:54.868811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863520+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:54.863520+0000","last_peered":"2023-10-14T11:23:54.863520+0000","last_clean":"2023-10-14T11:23:54.863520+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:54.863520+0000","last_undegraded":"2023-10-14T11:23:54.863520+0000","last_fullsized":"2023-10-14T11:23:54.863520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866212+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:54.866212+0000","last_peered":"2023-10-14T11:23:54.866212+0000","last_clean":"2023-10-14T11:23:54.866212+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:54.866212+0000","last_undegraded":"2023-10-14T11:23:54.866212+0000","last_fullsized":"2023-10-14T11:23:54.866212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.869513+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:54.869513+0000","last_peered":"2023-10-14T11:23:54.869513+0000","last_clean":"2023-10-14T11:23:54.869513+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:54.869513+0000","last_undegraded":"2023-10-14T11:23:54.869513+0000","last_fullsized":"2023-10-14T11:23:54.869513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.870989+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:54.870989+0000","last_peered":"2023-10-14T11:23:54.870989+0000","last_clean":"2023-10-14T11:23:54.870989+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:54.870989+0000","last_undegraded":"2023-10-14T11:23:54.870989+0000","last_fullsized":"2023-10-14T11:23:54.870989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.869486+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:54.869486+0000","last_peered":"2023-10-14T11:23:54.869486+0000","last_clean":"2023-10-14T11:23:54.869486+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:54.869486+0000","last_undegraded":"2023-10-14T11:23:54.869486+0000","last_fullsized":"2023-10-14T11:23:54.869486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.861344+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:54.861344+0000","last_peered":"2023-10-14T11:23:54.861344+0000","last_clean":"2023-10-14T11:23:54.861344+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:54.861344+0000","last_undegraded":"2023-10-14T11:23:54.861344+0000","last_fullsized":"2023-10-14T11:23:54.861344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.845307+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:54.845307+0000","last_peered":"2023-10-14T11:23:54.845307+0000","last_clean":"2023-10-14T11:23:54.845307+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:54.845307+0000","last_undegraded":"2023-10-14T11:23:54.845307+0000","last_fullsized":"2023-10-14T11:23:54.845307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868635+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:54.868635+0000","last_peered":"2023-10-14T11:23:54.868635+0000","last_clean":"2023-10-14T11:23:54.868635+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:54.868635+0000","last_undegraded":"2023-10-14T11:23:54.868635+0000","last_fullsized":"2023-10-14T11:23:54.868635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.856757+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:54.856757+0000","last_peered":"2023-10-14T11:23:54.856757+0000","last_clean":"2023-10-14T11:23:54.856757+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:54.856757+0000","last_undegraded":"2023-10-14T11:23:54.856757+0000","last_fullsized":"2023-10-14T11:23:54.856757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868919+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:54.868919+0000","last_peered":"2023-10-14T11:23:54.868919+0000","last_clean":"2023-10-14T11:23:54.868919+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:54.868919+0000","last_undegraded":"2023-10-14T11:23:54.868919+0000","last_fullsized":"2023-10-14T11:23:54.868919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873737+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:54.873737+0000","last_peered":"2023-10-14T11:23:54.873737+0000","last_clean":"2023-10-14T11:23:54.873737+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:54.873737+0000","last_undegraded":"2023-10-14T11:23:54.873737+0000","last_fullsized":"2023-10-14T11:23:54.873737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868527+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:54.868527+0000","last_peered":"2023-10-14T11:23:54.868527+0000","last_clean":"2023-10-14T11:23:54.868527+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:54.868527+0000","last_undegraded":"2023-10-14T11:23:54.868527+0000","last_fullsized":"2023-10-14T11:23:54.868527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866170+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:54.866170+0000","last_peered":"2023-10-14T11:23:54.866170+0000","last_clean":"2023-10-14T11:23:54.866170+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:54.866170+0000","last_undegraded":"2023-10-14T11:23:54.866170+0000","last_fullsized":"2023-10-14T11:23:54.866170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.857799+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:54.857799+0000","last_peered":"2023-10-14T11:23:54.857799+0000","last_clean":"2023-10-14T11:23:54.857799+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:54.857799+0000","last_undegraded":"2023-10-14T11:23:54.857799+0000","last_fullsized":"2023-10-14T11:23:54.857799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863613+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:54.863613+0000","last_peered":"2023-10-14T11:23:54.863613+0000","last_clean":"2023-10-14T11:23:54.863613+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:54.863613+0000","last_undegraded":"2023-10-14T11:23:54.863613+0000","last_fullsized":"2023-10-14T11:23:54.863613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868525+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:54.868525+0000","last_peered":"2023-10-14T11:23:54.868525+0000","last_clean":"2023-10-14T11:23:54.868525+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:54.868525+0000","last_undegraded":"2023-10-14T11:23:54.868525+0000","last_fullsized":"2023-10-14T11:23:54.868525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865112+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:54.865112+0000","last_peered":"2023-10-14T11:23:54.865112+0000","last_clean":"2023-10-14T11:23:54.865112+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:54.865112+0000","last_undegraded":"2023-10-14T11:23:54.865112+0000","last_fullsized":"2023-10-14T11:23:54.865112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.851918+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:54.851918+0000","last_peered":"2023-10-14T11:23:54.851918+0000","last_clean":"2023-10-14T11:23:54.851918+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:54.851918+0000","last_undegraded":"2023-10-14T11:23:54.851918+0000","last_fullsized":"2023-10-14T11:23:54.851918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868314+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:54.868314+0000","last_peered":"2023-10-14T11:23:54.868314+0000","last_clean":"2023-10-14T11:23:54.868314+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:54.868314+0000","last_undegraded":"2023-10-14T11:23:54.868314+0000","last_fullsized":"2023-10-14T11:23:54.868314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.849066+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:54.849066+0000","last_peered":"2023-10-14T11:23:54.849066+0000","last_clean":"2023-10-14T11:23:54.849066+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:54.849066+0000","last_undegraded":"2023-10-14T11:23:54.849066+0000","last_fullsized":"2023-10-14T11:23:54.849066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868631+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:54.868631+0000","last_peered":"2023-10-14T11:23:54.868631+0000","last_clean":"2023-10-14T11:23:54.868631+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:54.868631+0000","last_undegraded":"2023-10-14T11:23:54.868631+0000","last_fullsized":"2023-10-14T11:23:54.868631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.844137+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:54.844137+0000","last_peered":"2023-10-14T11:23:54.844137+0000","last_clean":"2023-10-14T11:23:54.844137+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:54.844137+0000","last_undegraded":"2023-10-14T11:23:54.844137+0000","last_fullsized":"2023-10-14T11:23:54.844137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873768+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:54.873768+0000","last_peered":"2023-10-14T11:23:54.873768+0000","last_clean":"2023-10-14T11:23:54.873768+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:54.873768+0000","last_undegraded":"2023-10-14T11:23:54.873768+0000","last_fullsized":"2023-10-14T11:23:54.873768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.856572+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:54.856572+0000","last_peered":"2023-10-14T11:23:54.856572+0000","last_clean":"2023-10-14T11:23:54.856572+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:54.856572+0000","last_undegraded":"2023-10-14T11:23:54.856572+0000","last_fullsized":"2023-10-14T11:23:54.856572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873706+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:54.873706+0000","last_peered":"2023-10-14T11:23:54.873706+0000","last_clean":"2023-10-14T11:23:54.873706+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:54.873706+0000","last_undegraded":"2023-10-14T11:23:54.873706+0000","last_fullsized":"2023-10-14T11:23:54.873706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.848901+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:54.848901+0000","last_peered":"2023-10-14T11:23:54.848901+0000","last_clean":"2023-10-14T11:23:54.848901+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:54.848901+0000","last_undegraded":"2023-10-14T11:23:54.848901+0000","last_fullsized":"2023-10-14T11:23:54.848901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859973+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:54.859973+0000","last_peered":"2023-10-14T11:23:54.859973+0000","last_clean":"2023-10-14T11:23:54.859973+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:54.859973+0000","last_undegraded":"2023-10-14T11:23:54.859973+0000","last_fullsized":"2023-10-14T11:23:54.859973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.851371+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:54.851371+0000","last_peered":"2023-10-14T11:23:54.851371+0000","last_clean":"2023-10-14T11:23:54.851371+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:54.851371+0000","last_undegraded":"2023-10-14T11:23:54.851371+0000","last_fullsized":"2023-10-14T11:23:54.851371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863550+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:54.863550+0000","last_peered":"2023-10-14T11:23:54.863550+0000","last_clean":"2023-10-14T11:23:54.863550+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:54.863550+0000","last_undegraded":"2023-10-14T11:23:54.863550+0000","last_fullsized":"2023-10-14T11:23:54.863550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868601+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:54.868601+0000","last_peered":"2023-10-14T11:23:54.868601+0000","last_clean":"2023-10-14T11:23:54.868601+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:54.868601+0000","last_undegraded":"2023-10-14T11:23:54.868601+0000","last_fullsized":"2023-10-14T11:23:54.868601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T11:23:53.844366+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:53.844366+0000","last_peered":"2023-10-14T11:23:53.844366+0000","last_clean":"2023-10-14T11:23:53.844366+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:53.844366+0000","last_undegraded":"2023-10-14T11:23:53.844366+0000","last_fullsized":"2023-10-14T11:23:53.844366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.443}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51000000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.375},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.377},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.623},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":722884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.314}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.309},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.27200000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.44},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.52600000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.39700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.247},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":132620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.375},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68899999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:59.004 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:23:59.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.159+0000 7f1900fb0700 1 Processor -- start 2023-10-14T11:23:59.162 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.159+0000 7f1900fb0700 1 -- start start 2023-10-14T11:23:59.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f18fc15e0c0 0x7f18fc072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc0c52c0 0x7f18fc0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc072ac0 con 0x7f18fc15e4a0 2023-10-14T11:23:59.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0cfa80 con 0x7f18fc15e0c0 2023-10-14T11:23:59.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f1900fb0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0cfd60 con 0x7f18fc0c52c0 2023-10-14T11:23:59.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43162/0 (socket says 172.21.15.67:43162) 2023-10-14T11:23:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 -- 172.21.15.67:0/1700431292 learned_addr learned my addr 172.21.15.67:0/1700431292 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18fa59c700 1 --2- 172.21.15.67:0/1700431292 >> v2:172.21.15.72:3300/0 conn(0x7f18fc15e0c0 0x7f18fc072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18fad9d700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc0c52c0 0x7f18fc0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 -- 172.21.15.67:0/1700431292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc0c52c0 msgr2=0x7f18fc0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc0c52c0 0x7f18fc0c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 -- 172.21.15.67:0/1700431292 >> v2:172.21.15.72:3300/0 conn(0x7f18fc15e0c0 msgr2=0x7f18fc072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/1700431292 >> v2:172.21.15.72:3300/0 conn(0x7f18fc15e0c0 0x7f18fc072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 -- 172.21.15.67:0/1700431292 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0d0040 con 0x7f18fc15e4a0 2023-10-14T11:23:59.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.160+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b6610 tx=0x7f18f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458c8a7c857f0b6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f18f959a700 1 -- 172.21.15.67:0/1700431292 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000b870 con 0x7f18fc15e4a0 2023-10-14T11:23:59.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f18f959a700 1 -- 172.21.15.67:0/1700431292 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000b9d0 con 0x7f18fc15e4a0 2023-10-14T11:23:59.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f18f959a700 1 -- 172.21.15.67:0/1700431292 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000bd60 con 0x7f18fc15e4a0 2023-10-14T11:23:59.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 -- 172.21.15.67:0/1700431292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc15e4a0 msgr2=0x7f18fc0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f18fc0b6610 tx=0x7f18f0009bd0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 -- 172.21.15.67:0/1700431292 shutdown_connections 2023-10-14T11:23:59.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc0c52c0 0x7f18fc0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 --2- 172.21.15.67:0/1700431292 >> v2:172.21.15.72:3300/0 conn(0x7f18fc15e0c0 0x7f18fc072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 --2- 172.21.15.67:0/1700431292 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc15e4a0 0x7f18fc0cf1c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 -- 172.21.15.67:0/1700431292 >> 172.21.15.67:0/1700431292 conn(0x7f18fc0d0440 msgr2=0x7f18fc0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:59.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 -- 172.21.15.67:0/1700431292 shutdown_connections 2023-10-14T11:23:59.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.161+0000 7f1900fb0700 1 -- 172.21.15.67:0/1700431292 wait complete. 2023-10-14T11:23:59.176 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 Processor -- start 2023-10-14T11:23:59.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 -- start start 2023-10-14T11:23:59.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18fc15e0c0 0x7f18fc156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.177 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc15e4a0 0x7f18fc156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc14a0c0 con 0x7f18fc0c52c0 2023-10-14T11:23:59.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc156d70 con 0x7f18fc15e0c0 2023-10-14T11:23:59.178 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f1900fb0700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc165fc0 con 0x7f18fc15e4a0 2023-10-14T11:23:59.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f18fa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f18fa59c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43168/0 (socket says 172.21.15.67:43168) 2023-10-14T11:23:59.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.163+0000 7f18fa59c700 1 -- 172.21.15.67:0/3760170820 learned_addr learned my addr 172.21.15.67:0/3760170820 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:59.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18fc15e0c0 0x7f18fc156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.179 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fad9d700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc15e4a0 0x7f18fc156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 -- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc15e4a0 msgr2=0x7f18fc156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc15e4a0 0x7f18fc156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 -- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18fc15e0c0 msgr2=0x7f18fc156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18fc15e0c0 0x7f18fc156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.180 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 -- 172.21.15.67:0/3760170820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009550 con 0x7f18fc0c52c0 2023-10-14T11:23:59.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18fa59c700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00e810 tx=0x7f18ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00c070 con 0x7f18fc0c52c0 2023-10-14T11:23:59.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec013610 con 0x7f18fc0c52c0 2023-10-14T11:23:59.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc149790 con 0x7f18fc0c52c0 2023-10-14T11:23:59.181 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0139c0 con 0x7f18fc0c52c0 2023-10-14T11:23:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.164+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc149d50 con 0x7f18fc0c52c0 2023-10-14T11:23:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.165+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc04ebb0 con 0x7f18fc0c52c0 2023-10-14T11:23:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.165+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18ec013b20 con 0x7f18fc0c52c0 2023-10-14T11:23:59.182 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.166+0000 7f18eaffd700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 0x7f18dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.166+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f18ec089330 con 0x7f18fc0c52c0 2023-10-14T11:23:59.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.166+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 0x7f18dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.166+0000 7f18f9d9b700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 0x7f18dc06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c10 tx=0x7f18f001d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.183 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.170+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18ec0543d0 con 0x7f18fc0c52c0 2023-10-14T11:23:59.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.365+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18fc151900 con 0x7f18dc06af00 2023-10-14T11:23:59.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.374+0000 7f18eaffd700 1 -- 172.21.15.67:0/3760170820 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289124 (secure 0 0 0) 0x7f18f000bbc0 con 0x7f18dc06af00 2023-10-14T11:23:59.380 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:23:59.382 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 msgr2=0x7f18dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 0x7f18dc06d3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009c10 tx=0x7f18f001d040 comp rx=0 tx=0).stop 2023-10-14T11:23:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 msgr2=0x7f18fc149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00e810 tx=0x7f18ec00eb20 comp rx=0 tx=0).stop 2023-10-14T11:23:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 shutdown_connections 2023-10-14T11:23:59.383 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f18fc15e4a0 0x7f18fc156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f18dc06af00 0x7f18dc06d3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f18fc0c52c0 0x7f18fc149080 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 --2- 172.21.15.67:0/3760170820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18fc15e0c0 0x7f18fc156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 >> 172.21.15.67:0/3760170820 conn(0x7f18fc0d0440 msgr2=0x7f18fc06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:59.384 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 shutdown_connections 2023-10-14T11:23:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.377+0000 7f1900fb0700 1 -- 172.21.15.67:0/3760170820 wait complete. 2023-10-14T11:23:59.385 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:23:59.392 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-10-14T11:23:58.415876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":3968,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4063232,"data_stored":2258334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.592172"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873757+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:54.873757+0000","last_peered":"2023-10-14T11:23:54.873757+0000","last_clean":"2023-10-14T11:23:54.873757+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:54.873757+0000","last_undegraded":"2023-10-14T11:23:54.873757+0000","last_fullsized":"2023-10-14T11:23:54.873757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868618+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:54.868618+0000","last_peered":"2023-10-14T11:23:54.868618+0000","last_clean":"2023-10-14T11:23:54.868618+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:54.868618+0000","last_undegraded":"2023-10-14T11:23:54.868618+0000","last_fullsized":"2023-10-14T11:23:54.868618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866213+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:54.866213+0000","last_peered":"2023-10-14T11:23:54.866213+0000","last_clean":"2023-10-14T11:23:54.866213+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:54.866213+0000","last_undegraded":"2023-10-14T11:23:54.866213+0000","last_fullsized":"2023-10-14T11:23:54.866213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863225+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:54.863225+0000","last_peered":"2023-10-14T11:23:54.863225+0000","last_clean":"2023-10-14T11:23:54.863225+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:54.863225+0000","last_undegraded":"2023-10-14T11:23:54.863225+0000","last_fullsized":"2023-10-14T11:23:54.863225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868694+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:54.868694+0000","last_peered":"2023-10-14T11:23:54.868694+0000","last_clean":"2023-10-14T11:23:54.868694+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:54.868694+0000","last_undegraded":"2023-10-14T11:23:54.868694+0000","last_fullsized":"2023-10-14T11:23:54.868694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863518+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:54.863518+0000","last_peered":"2023-10-14T11:23:54.863518+0000","last_clean":"2023-10-14T11:23:54.863518+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:54.863518+0000","last_undegraded":"2023-10-14T11:23:54.863518+0000","last_fullsized":"2023-10-14T11:23:54.863518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863439+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:54.863439+0000","last_peered":"2023-10-14T11:23:54.863439+0000","last_clean":"2023-10-14T11:23:54.863439+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:54.863439+0000","last_undegraded":"2023-10-14T11:23:54.863439+0000","last_fullsized":"2023-10-14T11:23:54.863439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865982+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:54.865982+0000","last_peered":"2023-10-14T11:23:54.865982+0000","last_clean":"2023-10-14T11:23:54.865982+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:54.865982+0000","last_undegraded":"2023-10-14T11:23:54.865982+0000","last_fullsized":"2023-10-14T11:23:54.865982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866075+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:54.866075+0000","last_peered":"2023-10-14T11:23:54.866075+0000","last_clean":"2023-10-14T11:23:54.866075+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:54.866075+0000","last_undegraded":"2023-10-14T11:23:54.866075+0000","last_fullsized":"2023-10-14T11:23:54.866075+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865764+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:54.865764+0000","last_peered":"2023-10-14T11:23:54.865764+0000","last_clean":"2023-10-14T11:23:54.865764+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:54.865764+0000","last_undegraded":"2023-10-14T11:23:54.865764+0000","last_fullsized":"2023-10-14T11:23:54.865764+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863894+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:54.863894+0000","last_peered":"2023-10-14T11:23:54.863894+0000","last_clean":"2023-10-14T11:23:54.863894+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:54.863894+0000","last_undegraded":"2023-10-14T11:23:54.863894+0000","last_fullsized":"2023-10-14T11:23:54.863894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:04.778293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859682+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:54.859682+0000","last_peered":"2023-10-14T11:23:54.859682+0000","last_clean":"2023-10-14T11:23:54.859682+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:54.859682+0000","last_undegraded":"2023-10-14T11:23:54.859682+0000","last_fullsized":"2023-10-14T11:23:54.859682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863684+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:54.863684+0000","last_peered":"2023-10-14T11:23:54.863684+0000","last_clean":"2023-10-14T11:23:54.863684+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:54.863684+0000","last_undegraded":"2023-10-14T11:23:54.863684+0000","last_fullsized":"2023-10-14T11:23:54.863684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.861588+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:54.861588+0000","last_peered":"2023-10-14T11:23:54.861588+0000","last_clean":"2023-10-14T11:23:54.861588+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:54.861588+0000","last_undegraded":"2023-10-14T11:23:54.861588+0000","last_fullsized":"2023-10-14T11:23:54.861588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.860863+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:54.860863+0000","last_peered":"2023-10-14T11:23:54.860863+0000","last_clean":"2023-10-14T11:23:54.860863+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:54.860863+0000","last_undegraded":"2023-10-14T11:23:54.860863+0000","last_fullsized":"2023-10-14T11:23:54.860863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866077+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:54.866077+0000","last_peered":"2023-10-14T11:23:54.866077+0000","last_clean":"2023-10-14T11:23:54.866077+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:54.866077+0000","last_undegraded":"2023-10-14T11:23:54.866077+0000","last_fullsized":"2023-10-14T11:23:54.866077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866193+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:54.866193+0000","last_peered":"2023-10-14T11:23:54.866193+0000","last_clean":"2023-10-14T11:23:54.866193+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:54.866193+0000","last_undegraded":"2023-10-14T11:23:54.866193+0000","last_fullsized":"2023-10-14T11:23:54.866193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859742+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:54.859742+0000","last_peered":"2023-10-14T11:23:54.859742+0000","last_clean":"2023-10-14T11:23:54.859742+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:54.859742+0000","last_undegraded":"2023-10-14T11:23:54.859742+0000","last_fullsized":"2023-10-14T11:23:54.859742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868811+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:54.868811+0000","last_peered":"2023-10-14T11:23:54.868811+0000","last_clean":"2023-10-14T11:23:54.868811+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:54.868811+0000","last_undegraded":"2023-10-14T11:23:54.868811+0000","last_fullsized":"2023-10-14T11:23:54.868811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863520+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:54.863520+0000","last_peered":"2023-10-14T11:23:54.863520+0000","last_clean":"2023-10-14T11:23:54.863520+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:54.863520+0000","last_undegraded":"2023-10-14T11:23:54.863520+0000","last_fullsized":"2023-10-14T11:23:54.863520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866212+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:54.866212+0000","last_peered":"2023-10-14T11:23:54.866212+0000","last_clean":"2023-10-14T11:23:54.866212+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:54.866212+0000","last_undegraded":"2023-10-14T11:23:54.866212+0000","last_fullsized":"2023-10-14T11:23:54.866212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.869513+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:54.869513+0000","last_peered":"2023-10-14T11:23:54.869513+0000","last_clean":"2023-10-14T11:23:54.869513+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:54.869513+0000","last_undegraded":"2023-10-14T11:23:54.869513+0000","last_fullsized":"2023-10-14T11:23:54.869513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.870989+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:54.870989+0000","last_peered":"2023-10-14T11:23:54.870989+0000","last_clean":"2023-10-14T11:23:54.870989+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:54.870989+0000","last_undegraded":"2023-10-14T11:23:54.870989+0000","last_fullsized":"2023-10-14T11:23:54.870989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.869486+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:54.869486+0000","last_peered":"2023-10-14T11:23:54.869486+0000","last_clean":"2023-10-14T11:23:54.869486+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:54.869486+0000","last_undegraded":"2023-10-14T11:23:54.869486+0000","last_fullsized":"2023-10-14T11:23:54.869486+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.861344+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:54.861344+0000","last_peered":"2023-10-14T11:23:54.861344+0000","last_clean":"2023-10-14T11:23:54.861344+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:54.861344+0000","last_undegraded":"2023-10-14T11:23:54.861344+0000","last_fullsized":"2023-10-14T11:23:54.861344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.845307+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:54.845307+0000","last_peered":"2023-10-14T11:23:54.845307+0000","last_clean":"2023-10-14T11:23:54.845307+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:54.845307+0000","last_undegraded":"2023-10-14T11:23:54.845307+0000","last_fullsized":"2023-10-14T11:23:54.845307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868635+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:54.868635+0000","last_peered":"2023-10-14T11:23:54.868635+0000","last_clean":"2023-10-14T11:23:54.868635+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:54.868635+0000","last_undegraded":"2023-10-14T11:23:54.868635+0000","last_fullsized":"2023-10-14T11:23:54.868635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.856757+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:54.856757+0000","last_peered":"2023-10-14T11:23:54.856757+0000","last_clean":"2023-10-14T11:23:54.856757+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:54.856757+0000","last_undegraded":"2023-10-14T11:23:54.856757+0000","last_fullsized":"2023-10-14T11:23:54.856757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868919+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:54.868919+0000","last_peered":"2023-10-14T11:23:54.868919+0000","last_clean":"2023-10-14T11:23:54.868919+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:54.868919+0000","last_undegraded":"2023-10-14T11:23:54.868919+0000","last_fullsized":"2023-10-14T11:23:54.868919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873737+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:54.873737+0000","last_peered":"2023-10-14T11:23:54.873737+0000","last_clean":"2023-10-14T11:23:54.873737+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:54.873737+0000","last_undegraded":"2023-10-14T11:23:54.873737+0000","last_fullsized":"2023-10-14T11:23:54.873737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868527+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:54.868527+0000","last_peered":"2023-10-14T11:23:54.868527+0000","last_clean":"2023-10-14T11:23:54.868527+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:54.868527+0000","last_undegraded":"2023-10-14T11:23:54.868527+0000","last_fullsized":"2023-10-14T11:23:54.868527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.866170+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:54.866170+0000","last_peered":"2023-10-14T11:23:54.866170+0000","last_clean":"2023-10-14T11:23:54.866170+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:54.866170+0000","last_undegraded":"2023-10-14T11:23:54.866170+0000","last_fullsized":"2023-10-14T11:23:54.866170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.857799+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:54.857799+0000","last_peered":"2023-10-14T11:23:54.857799+0000","last_clean":"2023-10-14T11:23:54.857799+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:54.857799+0000","last_undegraded":"2023-10-14T11:23:54.857799+0000","last_fullsized":"2023-10-14T11:23:54.857799+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863613+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:54.863613+0000","last_peered":"2023-10-14T11:23:54.863613+0000","last_clean":"2023-10-14T11:23:54.863613+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:54.863613+0000","last_undegraded":"2023-10-14T11:23:54.863613+0000","last_fullsized":"2023-10-14T11:23:54.863613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868525+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:54.868525+0000","last_peered":"2023-10-14T11:23:54.868525+0000","last_clean":"2023-10-14T11:23:54.868525+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:54.868525+0000","last_undegraded":"2023-10-14T11:23:54.868525+0000","last_fullsized":"2023-10-14T11:23:54.868525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.865112+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:54.865112+0000","last_peered":"2023-10-14T11:23:54.865112+0000","last_clean":"2023-10-14T11:23:54.865112+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:54.865112+0000","last_undegraded":"2023-10-14T11:23:54.865112+0000","last_fullsized":"2023-10-14T11:23:54.865112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.851918+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:54.851918+0000","last_peered":"2023-10-14T11:23:54.851918+0000","last_clean":"2023-10-14T11:23:54.851918+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:54.851918+0000","last_undegraded":"2023-10-14T11:23:54.851918+0000","last_fullsized":"2023-10-14T11:23:54.851918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868314+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:54.868314+0000","last_peered":"2023-10-14T11:23:54.868314+0000","last_clean":"2023-10-14T11:23:54.868314+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:54.868314+0000","last_undegraded":"2023-10-14T11:23:54.868314+0000","last_fullsized":"2023-10-14T11:23:54.868314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.849066+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:54.849066+0000","last_peered":"2023-10-14T11:23:54.849066+0000","last_clean":"2023-10-14T11:23:54.849066+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:54.849066+0000","last_undegraded":"2023-10-14T11:23:54.849066+0000","last_fullsized":"2023-10-14T11:23:54.849066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868631+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:54.868631+0000","last_peered":"2023-10-14T11:23:54.868631+0000","last_clean":"2023-10-14T11:23:54.868631+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:54.868631+0000","last_undegraded":"2023-10-14T11:23:54.868631+0000","last_fullsized":"2023-10-14T11:23:54.868631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.844137+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:54.844137+0000","last_peered":"2023-10-14T11:23:54.844137+0000","last_clean":"2023-10-14T11:23:54.844137+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:54.844137+0000","last_undegraded":"2023-10-14T11:23:54.844137+0000","last_fullsized":"2023-10-14T11:23:54.844137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873768+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:54.873768+0000","last_peered":"2023-10-14T11:23:54.873768+0000","last_clean":"2023-10-14T11:23:54.873768+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:54.873768+0000","last_undegraded":"2023-10-14T11:23:54.873768+0000","last_fullsized":"2023-10-14T11:23:54.873768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.856572+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:54.856572+0000","last_peered":"2023-10-14T11:23:54.856572+0000","last_clean":"2023-10-14T11:23:54.856572+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:54.856572+0000","last_undegraded":"2023-10-14T11:23:54.856572+0000","last_fullsized":"2023-10-14T11:23:54.856572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.873706+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:54.873706+0000","last_peered":"2023-10-14T11:23:54.873706+0000","last_clean":"2023-10-14T11:23:54.873706+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:54.873706+0000","last_undegraded":"2023-10-14T11:23:54.873706+0000","last_fullsized":"2023-10-14T11:23:54.873706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.848901+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:54.848901+0000","last_peered":"2023-10-14T11:23:54.848901+0000","last_clean":"2023-10-14T11:23:54.848901+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:54.848901+0000","last_undegraded":"2023-10-14T11:23:54.848901+0000","last_fullsized":"2023-10-14T11:23:54.848901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.859973+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:54.859973+0000","last_peered":"2023-10-14T11:23:54.859973+0000","last_clean":"2023-10-14T11:23:54.859973+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:54.859973+0000","last_undegraded":"2023-10-14T11:23:54.859973+0000","last_fullsized":"2023-10-14T11:23:54.859973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.851371+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:54.851371+0000","last_peered":"2023-10-14T11:23:54.851371+0000","last_clean":"2023-10-14T11:23:54.851371+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:54.851371+0000","last_undegraded":"2023-10-14T11:23:54.851371+0000","last_fullsized":"2023-10-14T11:23:54.851371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.863550+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:54.863550+0000","last_peered":"2023-10-14T11:23:54.863550+0000","last_clean":"2023-10-14T11:23:54.863550+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:54.863550+0000","last_undegraded":"2023-10-14T11:23:54.863550+0000","last_fullsized":"2023-10-14T11:23:54.863550+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.868601+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:54.868601+0000","last_peered":"2023-10-14T11:23:54.868601+0000","last_clean":"2023-10-14T11:23:54.868601+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:54.868601+0000","last_undegraded":"2023-10-14T11:23:54.868601+0000","last_fullsized":"2023-10-14T11:23:54.868601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-14T11:23:53.844366+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:53.844366+0000","last_peered":"2023-10-14T11:23:53.844366+0000","last_clean":"2023-10-14T11:23:53.844366+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:53.844366+0000","last_undegraded":"2023-10-14T11:23:53.844366+0000","last_fullsized":"2023-10-14T11:23:53.844366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":722974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.443}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.50900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.59999999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71299999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68600000000000005}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.624}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51000000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.375},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52000000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.47399999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.377},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.67300000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.66200000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.623},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":942080,"data_stored":722884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.314}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64700000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.63400000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70699999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":132586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.309},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.32700000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.27200000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44700000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.44},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.52600000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.50800000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.39700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38400000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.247},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.26400000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.32000000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65300000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":132620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.375},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.48399999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.60599999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.58999999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":133188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63200000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.68899999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58199999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60699999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.76200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:23:59.398 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T11:23:59.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T11:23:59.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.562+0000 7efc3347c700 1 Processor -- start 2023-10-14T11:23:59.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.562+0000 7efc3347c700 1 -- start start 2023-10-14T11:23:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc3347c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc2c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc3347c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efc2c15f4d0 0x7efc2c15f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.572 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc3347c700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c15cd20 con 0x7efc2c0b1140 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc3347c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c15fe80 con 0x7efc2c15f4d0 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc3347c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c15bee0 con 0x7efc2c0b08d0 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc30a17700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7efc2c0b1140 0x7efc2c15c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42470/0 (socket says 172.21.15.67:42470) 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.563+0000 7efc30a17700 1 -- 172.21.15.67:0/3322929958 learned_addr learned my addr 172.21.15.67:0/3322929958 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc31218700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc2c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.573 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc31a19700 1 --2- 172.21.15.67:0/3322929958 >> v2:172.21.15.72:3300/0 conn(0x7efc2c15f4d0 0x7efc2c15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866910218 0 0) 0x7efc2c15cd20 con 0x7efc2c0b1140 2023-10-14T11:23:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc180035b0 con 0x7efc2c0b1140 2023-10-14T11:23:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 202430138 0 0) 0x7efc180035b0 con 0x7efc2c0b1140 2023-10-14T11:23:59.574 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 msgr2=0x7efc2c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc2c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 >> v2:172.21.15.72:3300/0 conn(0x7efc2c15f4d0 msgr2=0x7efc2c15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 --2- 172.21.15.67:0/3322929958 >> v2:172.21.15.72:3300/0 conn(0x7efc2c15f4d0 0x7efc2c15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0b15d0 con 0x7efc2c0b1140 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7efc28001670 con 0x7efc2c0b1140 2023-10-14T11:23:59.575 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 >> v1:172.21.15.67:6789/0 conn(0x7efc2c0b1140 legacy=0x7efc2c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc18003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc18003f80 0x7efc18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc18004d90 0x7efc18005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c15bee0 con 0x7efc18003f80 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1800ba10 con 0x7efc18004d90 2023-10-14T11:23:59.576 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1800bb50 con 0x7efc2c0b08d0 2023-10-14T11:23:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc30a17700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc18003f80 0x7efc18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc31218700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc18003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc31a19700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc18004d90 0x7efc18005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.577 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.564+0000 7efc30a17700 1 -- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 msgr2=0x7efc18003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc30a17700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc2c0b08d0 0x7efc18003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc30a17700 1 -- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc18004d90 msgr2=0x7efc18005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:23:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc30a17700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc18004d90 0x7efc18005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.578 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc30a17700 1 -- 172.21.15.67:0/3322929958 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180035b0 con 0x7efc18003f80 2023-10-14T11:23:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc30a17700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc18003f80 0x7efc18004850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c320 tx=0x7efc18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a085e9356d0e3a2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800ce00 con 0x7efc18003f80 2023-10-14T11:23:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28005960 con 0x7efc18003f80 2023-10-14T11:23:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc23fff700 1 -- 172.21.15.67:0/3322929958 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28005d10 con 0x7efc18003f80 2023-10-14T11:23:59.579 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc3347c700 1 -- 172.21.15.67:0/3322929958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc18003f80 msgr2=0x7efc18004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc3347c700 1 --2- 172.21.15.67:0/3322929958 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc18003f80 0x7efc18004850 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c320 tx=0x7efc18005880 comp rx=0 tx=0).stop 2023-10-14T11:23:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc31a19700 1 -- 172.21.15.67:0/3322929958 reap_dead start 2023-10-14T11:23:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc3347c700 1 -- 172.21.15.67:0/3322929958 shutdown_connections 2023-10-14T11:23:59.580 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.565+0000 7efc3347c700 1 -- 172.21.15.67:0/3322929958 >> 172.21.15.67:0/3322929958 conn(0x7efc2c0d04b0 msgr2=0x7efc2c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.566+0000 7efc3347c700 1 -- 172.21.15.67:0/3322929958 shutdown_connections 2023-10-14T11:23:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.566+0000 7efc3347c700 1 -- 172.21.15.67:0/3322929958 wait complete. 2023-10-14T11:23:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 Processor -- start 2023-10-14T11:23:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 -- start start 2023-10-14T11:23:59.581 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc18003f80 0x7efc2c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c1f2a90 0x7efc2c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c14c4e0 con 0x7efc2c06e780 2023-10-14T11:23:59.582 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0cb040 con 0x7efc2c1f2a90 2023-10-14T11:23:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.567+0000 7efc3347c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0cbb10 con 0x7efc18003f80 2023-10-14T11:23:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43188/0 (socket says 172.21.15.67:43188) 2023-10-14T11:23:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 -- 172.21.15.67:0/2661792644 learned_addr learned my addr 172.21.15.67:0/2661792644 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:23:59.583 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc31218700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc18003f80 0x7efc2c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc31a19700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c1f2a90 0x7efc2c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 -- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc18003f80 msgr2=0x7efc2c0c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc18003f80 0x7efc2c0c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 -- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c1f2a90 msgr2=0x7efc2c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.584 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c1f2a90 0x7efc2c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 -- 172.21.15.67:0/2661792644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0cb270 con 0x7efc2c06e780 2023-10-14T11:23:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc30a17700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc180046f0 tx=0x7efc28001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800ce50 con 0x7efc2c06e780 2023-10-14T11:23:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28004a80 con 0x7efc2c06e780 2023-10-14T11:23:59.585 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28004e30 con 0x7efc2c06e780 2023-10-14T11:23:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0cb550 con 0x7efc2c06e780 2023-10-14T11:23:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.568+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0b48c0 con 0x7efc2c06e780 2023-10-14T11:23:59.586 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.569+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0b4720 con 0x7efc2c06e780 2023-10-14T11:23:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.570+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc280070d0 con 0x7efc2c06e780 2023-10-14T11:23:59.587 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.570+0000 7efc21ffb700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 0x7efc1006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:23:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.570+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7efc2808a980 con 0x7efc2c06e780 2023-10-14T11:23:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.570+0000 7efc31218700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 0x7efc1006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:23:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.571+0000 7efc31218700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 0x7efc1006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009b00 tx=0x7efc1c009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:23:59.588 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.575+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc2c0b4720 con 0x7efc2c06e780 2023-10-14T11:23:59.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.860+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7efc2c0b4720 con 0x7efc2c06e780 2023-10-14T11:23:59.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.862+0000 7efc21ffb700 1 -- 172.21.15.67:0/2661792644 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 195+0+152 (secure 0 0 0) 0x7efc2c0b4720 con 0x7efc2c06e780 2023-10-14T11:23:59.865 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2023-10-14T11:23:59.866 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQDfeSpl8t3yDhAAAGu18U/fwYpuJy9KZfW1kg== 2023-10-14T11:23:59.866 INFO:teuthology.orchestra.run.smithi067.stdout: caps mds = "allow" 2023-10-14T11:23:59.866 INFO:teuthology.orchestra.run.smithi067.stdout: caps mon = "allow r" 2023-10-14T11:23:59.866 INFO:teuthology.orchestra.run.smithi067.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T11:23:59.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 msgr2=0x7efc1006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 0x7efc1006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009b00 tx=0x7efc1c009210 comp rx=0 tx=0).stop 2023-10-14T11:23:59.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 msgr2=0x7efc2c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:23:59.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efc180046f0 tx=0x7efc28001a00 comp rx=0 tx=0).stop 2023-10-14T11:23:59.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 shutdown_connections 2023-10-14T11:23:59.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc2c1f2a90 0x7efc2c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7efc18003f80 0x7efc2c0c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7efc1006af00 0x7efc1006d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 --2- 172.21.15.67:0/2661792644 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7efc2c06e780 0x7efc2c0cab00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:23:59.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 >> 172.21.15.67:0/2661792644 conn(0x7efc2c0d04b0 msgr2=0x7efc2c0cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:23:59.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 shutdown_connections 2023-10-14T11:23:59.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:23:59.865+0000 7efc3347c700 1 -- 172.21.15.67:0/2661792644 wait complete. 2023-10-14T11:23:59.871 INFO:teuthology.orchestra.run.smithi067.stderr:updated caps for client.0 2023-10-14T11:23:59.881 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:24:00.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.003+0000 7fd3e549c700 1 Processor -- start 2023-10-14T11:24:00.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.003+0000 7fd3e549c700 1 -- start start 2023-10-14T11:24:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 0x7fd3e01617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 0x7fd3e0162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3e00ce840 0x7fd3e00cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00ce360 con 0x7fd3e00ce840 2023-10-14T11:24:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e00d00c0 con 0x7fd3e01610f0 2023-10-14T11:24:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3e549c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00d03a0 con 0x7fd3e0161d10 2023-10-14T11:24:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3e00ce840 0x7fd3e00cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd3e00ce840 0x7fd3e00cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43198/0 (socket says 172.21.15.67:43198) 2023-10-14T11:24:00.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 -- 172.21.15.67:0/1812179444 learned_addr learned my addr 172.21.15.67:0/1812179444 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3deffd700 1 --2- 172.21.15.67:0/1812179444 >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 0x7fd3e01617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 -- 172.21.15.67:0/1812179444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 msgr2=0x7fd3e0162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3de7fc700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 0x7fd3e0162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 0x7fd3e0162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 -- 172.21.15.67:0/1812179444 >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 msgr2=0x7fd3e01617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 --2- 172.21.15.67:0/1812179444 >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 0x7fd3e01617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3df7fe700 1 -- 172.21.15.67:0/1812179444 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e00d0680 con 0x7fd3e00ce840 2023-10-14T11:24:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3deffd700 1 --2- 172.21.15.67:0/1812179444 >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 0x7fd3e01617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.004+0000 7fd3de7fc700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 0x7fd3e0162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:00.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3df7fe700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e00cecb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3e008cfe0 tx=0x7fd3d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e56bd8a2813177f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3ddffb700 1 -- 172.21.15.67:0/1812179444 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800e070 con 0x7fd3e00ce840 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3ddffb700 1 -- 172.21.15.67:0/1812179444 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d800b9c0 con 0x7fd3e00ce840 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3ddffb700 1 -- 172.21.15.67:0/1812179444 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800bd70 con 0x7fd3e00ce840 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 -- 172.21.15.67:0/1812179444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 msgr2=0x7fd3e00cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e00cecb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd3e008cfe0 tx=0x7fd3d800b330 comp rx=0 tx=0).stop 2023-10-14T11:24:00.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 -- 172.21.15.67:0/1812179444 shutdown_connections 2023-10-14T11:24:00.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e00cecb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 --2- 172.21.15.67:0/1812179444 >> v2:172.21.15.72:3300/0 conn(0x7fd3e01610f0 0x7fd3e01617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 --2- 172.21.15.67:0/1812179444 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e0161d10 0x7fd3e0162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 -- 172.21.15.67:0/1812179444 >> 172.21.15.67:0/1812179444 conn(0x7fd3e009cab0 msgr2=0x7fd3e00d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 -- 172.21.15.67:0/1812179444 shutdown_connections 2023-10-14T11:24:00.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.005+0000 7fd3e549c700 1 -- 172.21.15.67:0/1812179444 wait complete. 2023-10-14T11:24:00.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 Processor -- start 2023-10-14T11:24:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 -- start start 2023-10-14T11:24:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e01610f0 0x7fd3e0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0161d10 0x7fd3e00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00cc240 con 0x7fd3e00ce840 2023-10-14T11:24:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00c7eb0 con 0x7fd3e0161d10 2023-10-14T11:24:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.007+0000 7fd3e549c700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e00c72a0 con 0x7fd3e01610f0 2023-10-14T11:24:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43200/0 (socket says 172.21.15.67:43200) 2023-10-14T11:24:00.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 -- 172.21.15.67:0/2989340645 learned_addr learned my addr 172.21.15.67:0/2989340645 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3de7fc700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e01610f0 0x7fd3e0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3df7fe700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0161d10 0x7fd3e00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 -- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e01610f0 msgr2=0x7fd3e0153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e01610f0 0x7fd3e0153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 -- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0161d10 msgr2=0x7fd3e00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0161d10 0x7fd3e00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 -- 172.21.15.67:0/2989340645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d8009b30 con 0x7fd3e00ce840 2023-10-14T11:24:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3deffd700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400c7c0 tx=0x7fd3d400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4005c20 con 0x7fd3e00ce840 2023-10-14T11:24:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d4005d80 con 0x7fd3e00ce840 2023-10-14T11:24:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e00c7580 con 0x7fd3e00ce840 2023-10-14T11:24:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4011820 con 0x7fd3e00ce840 2023-10-14T11:24:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.008+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e00c7b40 con 0x7fd3e00ce840 2023-10-14T11:24:00.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.009+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e004ebb0 con 0x7fd3e00ce840 2023-10-14T11:24:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.010+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd3d4011980 con 0x7fd3e00ce840 2023-10-14T11:24:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.010+0000 7fd3c77fe700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 0x7fd3cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.010+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd3d4089260 con 0x7fd3e00ce840 2023-10-14T11:24:00.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.010+0000 7fd3de7fc700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 0x7fd3cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.011+0000 7fd3de7fc700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 0x7fd3cc06d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0152ee0 tx=0x7fd3d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.015+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd3d40542f0 con 0x7fd3e00ce840 2023-10-14T11:24:00.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.261+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3e00d0dd0 con 0x7fd3e00ce840 2023-10-14T11:24:00.266 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.262+0000 7fd3c77fe700 1 -- 172.21.15.67:0/2989340645 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fd3d4057910 con 0x7fd3e00ce840 2023-10-14T11:24:00.267 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:00.267 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1587797003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1587797003},{"type":"v1","addr":"172.21.15.72:6837","nonce":1587797003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3653699709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3653699709},{"type":"v1","addr":"172.21.15.67:6835","nonce":3653699709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3108239461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3108239461},{"type":"v1","addr":"172.21.15.72:6836","nonce":3108239461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:23:54.252164+0000","modified":"2023-10-14T11:23:57.270421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/2432149351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2432149351},{"type":"v1","addr":"172.21.15.67:6834","nonce":2432149351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:24:00.268 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 msgr2=0x7fd3cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 0x7fd3cc06d3c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0152ee0 tx=0x7fd3d0008040 comp rx=0 tx=0).stop 2023-10-14T11:24:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 msgr2=0x7fd3e01529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400c7c0 tx=0x7fd3d400cad0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 shutdown_connections 2023-10-14T11:24:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd3e0161d10 0x7fd3e00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd3cc06af00 0x7fd3cc06d3c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd3e00ce840 0x7fd3e01529a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 --2- 172.21.15.67:0/2989340645 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd3e01610f0 0x7fd3e0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 >> 172.21.15.67:0/2989340645 conn(0x7fd3e009cab0 msgr2=0x7fd3e015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 shutdown_connections 2023-10-14T11:24:00.271 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.264+0000 7fd3e549c700 1 -- 172.21.15.67:0/2989340645 wait complete. 2023-10-14T11:24:00.271 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2023-10-14T11:24:00.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T11:23:54.252164+0000', 'modified': '2023-10-14T11:23:57.270421+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5073}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5073': {'gid': 5073, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.67:6834/2432149351', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.67:6832', 'nonce': 2432149351}, {'type': 'v1', 'addr': '172.21.15.67:6834', 'nonce': 2432149351}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T11:24:00.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T11:24:00.682 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-14T11:24:00.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.809+0000 7fbe50461700 1 Processor -- start 2023-10-14T11:24:00.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.809+0000 7fbe50461700 1 -- start start 2023-10-14T11:24:00.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe50461700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe480cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe50461700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe4815f160 0x7fbe480b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe50461700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe480cff10 con 0x7fbe480d0fb0 2023-10-14T11:24:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe50461700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe480d0b90 con 0x7fbe4815f160 2023-10-14T11:24:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe50461700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480d01f0 con 0x7fbe4815ed80 2023-10-14T11:24:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe4815f160 0x7fbe480b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbe4815f160 0x7fbe480b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43210/0 (socket says 172.21.15.67:43210) 2023-10-14T11:24:00.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 -- 172.21.15.67:0/393299909 learned_addr learned my addr 172.21.15.67:0/393299909 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe480cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 -- 172.21.15.67:0/393299909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 msgr2=0x7fbe480cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe480cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 -- 172.21.15.67:0/393299909 >> v1:172.21.15.72:6789/0 conn(0x7fbe480d0fb0 legacy=0x7fbe4806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.817 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.810+0000 7fbe4d9fc700 1 -- 172.21.15.67:0/393299909 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480d04d0 con 0x7fbe4815f160 2023-10-14T11:24:00.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe4d9fc700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe480b3070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098f0 tx=0x7fbe44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae8d681ad144de6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe4d1fb700 1 -- 172.21.15.67:0/393299909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400b8a0 con 0x7fbe4815f160 2023-10-14T11:24:00.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe4d1fb700 1 -- 172.21.15.67:0/393299909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400ba00 con 0x7fbe4815f160 2023-10-14T11:24:00.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe4d1fb700 1 -- 172.21.15.67:0/393299909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400bd90 con 0x7fbe4815f160 2023-10-14T11:24:00.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 -- 172.21.15.67:0/393299909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 msgr2=0x7fbe480b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe480b3070 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbe440098f0 tx=0x7fbe44009c00 comp rx=0 tx=0).stop 2023-10-14T11:24:00.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 -- 172.21.15.67:0/393299909 shutdown_connections 2023-10-14T11:24:00.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe480cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 --2- 172.21.15.67:0/393299909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe480b3070 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 -- 172.21.15.67:0/393299909 >> 172.21.15.67:0/393299909 conn(0x7fbe480ce070 msgr2=0x7fbe480ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 -- 172.21.15.67:0/393299909 shutdown_connections 2023-10-14T11:24:00.820 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.811+0000 7fbe50461700 1 -- 172.21.15.67:0/393299909 wait complete. 2023-10-14T11:24:00.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 Processor -- start 2023-10-14T11:24:00.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 -- start start 2023-10-14T11:24:00.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe480d0fb0 0x7fbe480c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.829 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe4806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481f30e0 con 0x7fbe4815f160 2023-10-14T11:24:00.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4806d310 con 0x7fbe480d0fb0 2023-10-14T11:24:00.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.813+0000 7fbe50461700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe480b21f0 con 0x7fbe4815ed80 2023-10-14T11:24:00.830 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e1fd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe480d0fb0 0x7fbe480c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43218/0 (socket says 172.21.15.67:43218) 2023-10-14T11:24:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4d9fc700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe4806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3134510763 learned_addr learned my addr 172.21.15.67:0/3134510763 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 msgr2=0x7fbe4806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe4806cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe480d0fb0 msgr2=0x7fbe480c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe480d0fb0 0x7fbe480c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3134510763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44009550 con 0x7fbe4815f160 2023-10-14T11:24:00.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000cc80 tx=0x7fbe4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe3effd700 1 -- 172.21.15.67:0/3134510763 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40003c00 con 0x7fbe4815f160 2023-10-14T11:24:00.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe3effd700 1 -- 172.21.15.67:0/3134510763 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40003d60 con 0x7fbe4815f160 2023-10-14T11:24:00.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480c98a0 con 0x7fbe4815f160 2023-10-14T11:24:00.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe3effd700 1 -- 172.21.15.67:0/3134510763 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4000aaa0 con 0x7fbe4815f160 2023-10-14T11:24:00.833 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.814+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480c92e0 con 0x7fbe4815f160 2023-10-14T11:24:00.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.816+0000 7fbe3effd700 1 -- 172.21.15.67:0/3134510763 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbe4000ac00 con 0x7fbe4815f160 2023-10-14T11:24:00.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.816+0000 7fbe3effd700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 0x7fbe2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.816+0000 7fbe3effd700 1 -- 172.21.15.67:0/3134510763 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbe40089670 con 0x7fbe4815f160 2023-10-14T11:24:00.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.816+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 0x7fbe2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.817+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 0x7fbe2c06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006fd0 tx=0x7fbe38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.818+0000 7fbe5c64bb80 1 Processor -- start 2023-10-14T11:24:00.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.818+0000 7fbe5c64bb80 1 -- start start 2023-10-14T11:24:00.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f92034fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f91f7ec20 con 0x558f9202d220 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f91f63c10 con 0x558f92008010 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f91f61530 con 0x558f92032630 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43222/0 (socket says 172.21.15.67:43222) 2023-10-14T11:24:00.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/3323088119 learned_addr learned my addr 172.21.15.67:0/3323088119 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 msgr2=0x558f92034fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f92034fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 msgr2=0x558f920086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.819+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/3323088119 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f91f1a3a0 con 0x558f9202d220 2023-10-14T11:24:00.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a80 tx=0x7fbe38014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d878c2f65eafed4a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe2bfff700 1 -- 172.21.15.67:0/3323088119 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38015740 con 0x558f9202d220 2023-10-14T11:24:00.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe2bfff700 1 -- 172.21.15.67:0/3323088119 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380158a0 con 0x558f9202d220 2023-10-14T11:24:00.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe2bfff700 1 -- 172.21.15.67:0/3323088119 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38015c10 con 0x558f9202d220 2023-10-14T11:24:00.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3323088119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 msgr2=0x558f92034a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.820+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a80 tx=0x7fbe38014000 comp rx=0 tx=0).stop 2023-10-14T11:24:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3323088119 shutdown_connections 2023-10-14T11:24:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f9202d220 0x558f92034a70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3323088119 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f92034fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3323088119 >> 172.21.15.67:0/3323088119 conn(0x558f91f37d80 msgr2=0x558f92052ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3323088119 shutdown_connections 2023-10-14T11:24:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3323088119 wait complete. 2023-10-14T11:24:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 -- start start 2023-10-14T11:24:00.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.821+0000 7fbe5c64bb80 1 Processor -- start 2023-10-14T11:24:00.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92008010 0x558f92035730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f92037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f91f5ce20 con 0x558f92032630 2023-10-14T11:24:00.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f91ef96c0 con 0x558f9202d220 2023-10-14T11:24:00.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f91ef9360 con 0x558f92008010 2023-10-14T11:24:00.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe5c64bb80 10 client.0 _ll_register_callbacks cb 0x558f91d567b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:24:00.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43232/0 (socket says 172.21.15.67:43232) 2023-10-14T11:24:00.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3280975727 learned_addr learned my addr 172.21.15.67:0/3280975727 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe4d9fc700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f92037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.822+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92008010 0x558f92035730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92008010 msgr2=0x558f92035730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92008010 0x558f92035730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.843 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 msgr2=0x558f92037bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f92037bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/3280975727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3800e040 con 0x558f92032630 2023-10-14T11:24:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbe400600f0 tx=0x7fbe40057d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82de9229b95cbc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2023-10-14T11:24:00.844 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40058320 con 0x558f92032630 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbe4005c470 con 0x558f92032630 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f91ffd5b0 con 0x558f92032630 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe40060620 con 0x558f92032630 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe5c64bb80 10 client.5238 fetch_fsmap learned FSMap version 16 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558f91d87d90 con 0x558f92032630 2023-10-14T11:24:00.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40073020 con 0x558f92032630 2023-10-14T11:24:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fbe40058580 con 0x558f92032630 2023-10-14T11:24:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.823+0000 7fbe5c64bb80 10 client.5238 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T11:24:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe5c64bb80 10 client.5238 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T11:24:00.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe5c64bb80 20 client.5238 populate_metadata read hostname 'smithi067' 2023-10-14T11:24:00.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f9205f380 0x558f9205f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe5c64bb80 4 client.5238 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T11:24:00.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 --> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f91f55e00 con 0x558f9205f380 2023-10-14T11:24:00.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f9205f380 0x558f9205f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe297fa700 10 client.5238 ms_handle_connect on v2:172.21.15.67:6832/2432149351 2023-10-14T11:24:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.824+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f9205f380 0x558f9205f760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819a48f9e9f3151a server_cookie=b518fc1da23ebffa in_seq=0 out_seq=0 2023-10-14T11:24:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe297fa700 1 -- 172.21.15.67:0/3280975727 <== mds.0 v2:172.21.15.67:6832/2432149351 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f91f55e00 con 0x558f9205f380 2023-10-14T11:24:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe297fa700 10 client.5238 handle_command_reply: tid=0 2023-10-14T11:24:00.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 client.5238 shutdown 2023-10-14T11:24:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 msgr2=0x558f920380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbe400600f0 tx=0x7fbe40057d70 comp rx=0 tx=0).stop 2023-10-14T11:24:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 shutdown_connections 2023-10-14T11:24:00.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f9205f380 0x558f9205f760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f920380f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92008010 0x558f92035730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe297fa700 0 client.5238 ms_handle_reset on v2:172.21.15.67:6832/2432149351 2023-10-14T11:24:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/3280975727 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f92037bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 >> 172.21.15.67:0/3280975727 conn(0x558f91f37d80 msgr2=0x558f920504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 shutdown_connections 2023-10-14T11:24:00.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/3280975727 wait complete. 2023-10-14T11:24:00.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.825+0000 7fbe5c64bb80 20 client.5238 trim_cache size 0 max 16384 2023-10-14T11:24:00.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.843+0000 7fbe5c64bb80 1 Processor -- start 2023-10-14T11:24:00.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.843+0000 7fbe5c64bb80 1 -- start start 2023-10-14T11:24:00.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f9204fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f9200a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f91ddd8d0 con 0x558f92008010 2023-10-14T11:24:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f920305c0 con 0x558f9202d220 2023-10-14T11:24:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f92005ec0 con 0x558f92032630 2023-10-14T11:24:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.858 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43236/0 (socket says 172.21.15.67:43236) 2023-10-14T11:24:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/2629020837 learned_addr learned my addr 172.21.15.67:0/2629020837 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f9200a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4d9fc700 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f9204fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 msgr2=0x558f9200a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f9200a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 msgr2=0x558f9204fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f9204fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 -- 172.21.15.67:0/2629020837 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9202cea0 con 0x558f92008010 2023-10-14T11:24:00.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.844+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a30 tx=0x7fbe38020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ff285f1b6aed9b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe3cd82700 1 -- 172.21.15.67:0/2629020837 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38031040 con 0x558f92008010 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe3cd82700 1 -- 172.21.15.67:0/2629020837 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38015c30 con 0x558f92008010 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe3cd82700 1 -- 172.21.15.67:0/2629020837 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38035730 con 0x558f92008010 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2629020837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 msgr2=0x558f9204f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006a30 tx=0x7fbe38020000 comp rx=0 tx=0).stop 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2629020837 shutdown_connections 2023-10-14T11:24:00.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f92032630 0x558f9200a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92008010 0x558f9204f6e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2629020837 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f9202d220 0x558f9204fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2629020837 >> 172.21.15.67:0/2629020837 conn(0x558f91f37d80 msgr2=0x558f9202f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.862 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2629020837 shutdown_connections 2023-10-14T11:24:00.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.845+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2629020837 wait complete. 2023-10-14T11:24:00.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.846+0000 7fbe5c64bb80 1 -- start start 2023-10-14T11:24:00.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.846+0000 7fbe5c64bb80 1 Processor -- start 2023-10-14T11:24:00.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.863 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f9202d220 0x558f9209c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9204fcd0 con 0x558f92032630 2023-10-14T11:24:00.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9209c660 con 0x558f92008010 2023-10-14T11:24:00.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9204f6e0 con 0x558f9202d220 2023-10-14T11:24:00.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe5c64bb80 10 client.0 _ll_register_callbacks cb 0x7fbe400581a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T11:24:00.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43244/0 (socket says 172.21.15.67:43244) 2023-10-14T11:24:00.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/2239369565 learned_addr learned my addr 172.21.15.67:0/2239369565 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:00.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4d9fc700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f9202d220 0x558f9209c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f9202d220 msgr2=0x558f9209c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f9202d220 0x558f9209c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 msgr2=0x558f920357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:00.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920357e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 -- 172.21.15.67:0/2239369565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f91f1a3a0 con 0x558f92032630 2023-10-14T11:24:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe4e9fe700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbe40087e50 tx=0x7fbe400014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9260a943c6c7ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe297fa700 10 client.0 ms_handle_connect on v2:172.21.15.67:3300/0 2023-10-14T11:24:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.847+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4007a070 con 0x558f92032630 2023-10-14T11:24:00.867 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mon.0 v2:172.21.15.67:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbe40074080 con 0x558f92032630 2023-10-14T11:24:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe380158a0 con 0x558f92032630 2023-10-14T11:24:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe40057c80 con 0x558f92032630 2023-10-14T11:24:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 10 client.5244 fetch_fsmap learned FSMap version 16 2023-10-14T11:24:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558f91d70c10 con 0x558f92032630 2023-10-14T11:24:00.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mon.0 v2:172.21.15.67:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380158a0 con 0x558f92032630 2023-10-14T11:24:00.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mon.0 v2:172.21.15.67:3300/0 5 ==== fsmap(e 16) v1 ==== 3299+0+0 (secure 0 0 0) 0x7fbe4007d020 con 0x558f92032630 2023-10-14T11:24:00.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 10 client.5244 fetch_fsmap finished waiting for FSMap version 16 2023-10-14T11:24:00.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 10 client.5244 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-14T11:24:00.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 20 client.5244 populate_metadata read hostname 'smithi067' 2023-10-14T11:24:00.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f920b9790 0x558f920b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:00.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 4 client.5244 mds_command: new command op to 5073 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T11:24:00.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 --> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558f91f55b20 con 0x558f920b9790 2023-10-14T11:24:00.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f920b9790 0x558f920b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:00.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe297fa700 10 client.5244 ms_handle_connect on v2:172.21.15.67:6832/2432149351 2023-10-14T11:24:00.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.848+0000 7fbe4e1fd700 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f920b9790 0x558f920b9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9dbe96b2206fbf2 server_cookie=605d55c19dde7986 in_seq=0 out_seq=0 2023-10-14T11:24:00.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe297fa700 1 -- 172.21.15.67:0/2239369565 <== mds.0 v2:172.21.15.67:6832/2432149351 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x558f91f55b20 con 0x558f920b9790 2023-10-14T11:24:00.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe297fa700 10 client.5244 handle_command_reply: tid=0 2023-10-14T11:24:00.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 client.5244 shutdown 2023-10-14T11:24:00.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 msgr2=0x558f9202e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbe40087e50 tx=0x7fbe400014a0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 shutdown_connections 2023-10-14T11:24:00.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:6832/2432149351,v1:172.21.15.67:6834/2432149351] conn(0x558f920b9790 0x558f920b9b70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x558f92032630 0x558f9202e650 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558f92008010 0x558f920357e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 --2- 172.21.15.67:0/2239369565 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x558f9202d220 0x558f9209c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe297fa700 0 client.5244 ms_handle_reset on v2:172.21.15.67:6832/2432149351 2023-10-14T11:24:00.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 >> 172.21.15.67:0/2239369565 conn(0x558f91f37d80 msgr2=0x558f920382e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 shutdown_connections 2023-10-14T11:24:00.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 1 -- 172.21.15.67:0/2239369565 wait complete. 2023-10-14T11:24:00.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe5c64bb80 20 client.5244 trim_cache size 0 max 16384 2023-10-14T11:24:00.874 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:00.874 INFO:teuthology.orchestra.run.smithi067.stdout: "cluster_fsid": "c6e5b03d-6480-4879-8e8f-035e52bef8e2", 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "whoami": 0, 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "id": 5073, 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "want_state": "up:active", 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "state": "up:active", 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "fs_name": "testcephfs1", 2023-10-14T11:24:00.875 INFO:teuthology.orchestra.run.smithi067.stdout: "rank_uptime": 6.004156536, 2023-10-14T11:24:00.876 INFO:teuthology.orchestra.run.smithi067.stdout: "mdsmap_epoch": 16, 2023-10-14T11:24:00.876 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch": 32, 2023-10-14T11:24:00.876 INFO:teuthology.orchestra.run.smithi067.stdout: "osdmap_epoch_barrier": 32, 2023-10-14T11:24:00.876 INFO:teuthology.orchestra.run.smithi067.stdout: "uptime": 13.893301675 2023-10-14T11:24:00.877 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:00.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 msgr2=0x7fbe2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 0x7fbe2c06d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe38006fd0 tx=0x7fbe38008040 comp rx=0 tx=0).stop 2023-10-14T11:24:00.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 msgr2=0x7fbe481595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:00.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.849+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000cc80 tx=0x7fbe4000cf90 comp rx=0 tx=0).stop 2023-10-14T11:24:00.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 shutdown_connections 2023-10-14T11:24:00.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbe2c06af00 0x7fbe2c06d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbe4815f160 0x7fbe481595c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe480d0fb0 0x7fbe480c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 --2- 172.21.15.67:0/3134510763 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbe4815ed80 0x7fbe4806cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:00.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 >> 172.21.15.67:0/3134510763 conn(0x7fbe480ce070 msgr2=0x7fbe480b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:00.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 shutdown_connections 2023-10-14T11:24:00.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:00.850+0000 7fbe50461700 1 -- 172.21.15.67:0/3134510763 wait complete. 2023-10-14T11:24:00.881 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T11:24:01.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.005+0000 7faba696f700 1 Processor -- start 2023-10-14T11:24:01.016 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.005+0000 7faba696f700 1 -- start start 2023-10-14T11:24:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba696f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7faba006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba696f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba015de40 con 0x7faba006adc0 2023-10-14T11:24:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba696f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba01616f0 con 0x7faba015da60 2023-10-14T11:24:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba696f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba01624b0 con 0x7faba00c5be0 2023-10-14T11:24:01.017 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba4f0c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7faba006adc0 0x7faba0071be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42548/0 (socket says 172.21.15.67:42548) 2023-10-14T11:24:01.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.006+0000 7faba4f0c700 1 -- 172.21.15.67:0/2578987458 learned_addr learned my addr 172.21.15.67:0/2578987458 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:01.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9f7fe700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7faba006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.018 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183439648 0 0) 0x7faba015de40 con 0x7faba006adc0 2023-10-14T11:24:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab8c0035b0 con 0x7faba006adc0 2023-10-14T11:24:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139380192 0 0) 0x7faba01616f0 con 0x7faba015da60 2023-10-14T11:24:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba015de40 con 0x7faba015da60 2023-10-14T11:24:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1692076273 0 0) 0x7fab8c0035b0 con 0x7faba006adc0 2023-10-14T11:24:01.019 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 msgr2=0x7faba006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7faba006a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 >> v1:172.21.15.72:6789/0 conn(0x7faba015da60 legacy=0x7faba00c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.020 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba01619d0 con 0x7faba006adc0 2023-10-14T11:24:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7fab980019f0 con 0x7faba006adc0 2023-10-14T11:24:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9f7fe700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7faba006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:24:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 >> v1:172.21.15.67:6789/0 conn(0x7faba006adc0 legacy=0x7faba0071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.021 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7fab8c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab8c004100 0x7fab8c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c004d90 0x7fab8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01624b0 con 0x7fab8c004d90 2023-10-14T11:24:01.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00bac0 con 0x7fab8c004100 2023-10-14T11:24:01.022 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00bc80 con 0x7faba00c5be0 2023-10-14T11:24:01.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7faba4f0c700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c004d90 0x7fab8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9ffff700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7fab8c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.007+0000 7fab9f7fe700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab8c004100 0x7fab8c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 -- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 msgr2=0x7fab8c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:01.023 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00c5be0 0x7fab8c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 -- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab8c004100 msgr2=0x7fab8c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:01.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab8c004100 0x7fab8c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 -- 172.21.15.67:0/2578987458 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880094a0 con 0x7fab8c004d90 2023-10-14T11:24:01.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c004d90 0x7fab8c005210 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab9800a7a0 tx=0x7fab8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159ccb987b823b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:01.024 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98012600 con 0x7fab8c004d90 2023-10-14T11:24:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98012780 con 0x7fab8c004d90 2023-10-14T11:24:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7fab9effd700 1 -- 172.21.15.67:0/2578987458 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98012b30 con 0x7fab8c004d90 2023-10-14T11:24:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 -- 172.21.15.67:0/2578987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c004d90 msgr2=0x7fab8c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 --2- 172.21.15.67:0/2578987458 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fab8c004d90 0x7fab8c005210 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fab9800a7a0 tx=0x7fab8c005880 comp rx=0 tx=0).stop 2023-10-14T11:24:01.025 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba4f0c700 1 -- 172.21.15.67:0/2578987458 reap_dead start 2023-10-14T11:24:01.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 -- 172.21.15.67:0/2578987458 shutdown_connections 2023-10-14T11:24:01.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 -- 172.21.15.67:0/2578987458 >> 172.21.15.67:0/2578987458 conn(0x7faba00d0440 msgr2=0x7faba00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:01.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 -- 172.21.15.67:0/2578987458 shutdown_connections 2023-10-14T11:24:01.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.008+0000 7faba696f700 1 -- 172.21.15.67:0/2578987458 wait complete. 2023-10-14T11:24:01.026 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.010+0000 7faba696f700 1 Processor -- start 2023-10-14T11:24:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.010+0000 7faba696f700 1 -- start start 2023-10-14T11:24:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.010+0000 7faba696f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00b57a0 0x7faba015f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba00b5b80 0x7faba00ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.027 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba01603c0 con 0x7faba00acd30 2023-10-14T11:24:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00ad1b0 con 0x7faba00b5b80 2023-10-14T11:24:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba015f740 con 0x7faba00b57a0 2023-10-14T11:24:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43266/0 (socket says 172.21.15.67:43266) 2023-10-14T11:24:01.028 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 -- 172.21.15.67:0/4020569904 learned_addr learned my addr 172.21.15.67:0/4020569904 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:01.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7fab9ffff700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00b57a0 0x7faba015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7fab9f7fe700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba00b5b80 0x7faba00ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 -- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00b57a0 msgr2=0x7faba015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00b57a0 0x7faba015f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.029 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 -- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba00b5b80 msgr2=0x7faba00ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba00b5b80 0x7faba00ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 -- 172.21.15.67:0/4020569904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba015fa20 con 0x7faba00acd30 2023-10-14T11:24:01.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba4f0c700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab98001c30 tx=0x7fab98001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:01.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98012d00 con 0x7faba00acd30 2023-10-14T11:24:01.030 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98012e80 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba015fd00 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9801d630 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.011+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba01607e0 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.012+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba004ebb0 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.013+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab98019070 con 0x7faba00acd30 2023-10-14T11:24:01.031 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.013+0000 7fab9cff9700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 0x7fab8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:01.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.013+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fab9808acb0 con 0x7faba00acd30 2023-10-14T11:24:01.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.013+0000 7fab9ffff700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 0x7fab8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:01.032 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.014+0000 7fab9ffff700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 0x7fab8006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab90000c00 tx=0x7fab90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:01.033 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.018+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab98055fa0 con 0x7faba00acd30 2023-10-14T11:24:01.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.266+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faba0160970 con 0x7faba00acd30 2023-10-14T11:24:01.269 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.266+0000 7fab9cff9700 1 -- 172.21.15.67:0/4020569904 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+88 (secure 0 0 0) 0x7fab9802c070 con 0x7faba00acd30 2023-10-14T11:24:01.270 INFO:teuthology.orchestra.run.smithi067.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T11:24:01.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 msgr2=0x7fab8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 0x7fab8006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fab90000c00 tx=0x7fab90009040 comp rx=0 tx=0).stop 2023-10-14T11:24:01.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 msgr2=0x7faba01f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:01.272 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fab98001c30 tx=0x7fab98001d00 comp rx=0 tx=0).stop 2023-10-14T11:24:01.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 shutdown_connections 2023-10-14T11:24:01.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.268+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fab8006af00 0x7fab8006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7faba00acd30 0x7faba01f64d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7faba00b57a0 0x7faba015f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 --2- 172.21.15.67:0/4020569904 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faba00b5b80 0x7faba00ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:01.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 >> 172.21.15.67:0/4020569904 conn(0x7faba00d0440 msgr2=0x7faba0071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:01.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 shutdown_connections 2023-10-14T11:24:01.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:01.269+0000 7faba696f700 1 -- 172.21.15.67:0/4020569904 wait complete. 2023-10-14T11:24:01.284 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T11:24:01.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T11:24:01.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi067.front.sepia.ceph.com 2023-10-14T11:24:01.286 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T11:24:01.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T11:24:01.286 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T11:24:01.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-14T11:24:01.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T11:24:01.288 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:24:01.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.290 DEBUG:teuthology.orchestra.run.smithi067:> ip addr 2023-10-14T11:24:01.309 INFO:teuthology.orchestra.run.smithi067.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T11:24:01.309 INFO:teuthology.orchestra.run.smithi067.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T11:24:01.309 INFO:teuthology.orchestra.run.smithi067.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T11:24:01.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.310 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 ::1/128 scope host 2023-10-14T11:24:01.310 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.310 INFO:teuthology.orchestra.run.smithi067.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:24:01.310 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7e brd ff:ff:ff:ff:ff:ff 2023-10-14T11:24:01.311 INFO:teuthology.orchestra.run.smithi067.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:24:01.311 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:a8:b4:7f brd ff:ff:ff:ff:ff:ff 2023-10-14T11:24:01.311 INFO:teuthology.orchestra.run.smithi067.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T11:24:01.311 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0a brd ff:ff:ff:ff:ff:ff 2023-10-14T11:24:01.311 INFO:teuthology.orchestra.run.smithi067.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T11:24:01.312 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 0c:c4:7a:b6:fc:0b brd ff:ff:ff:ff:ff:ff 2023-10-14T11:24:01.312 INFO:teuthology.orchestra.run.smithi067.stdout: inet 172.21.15.67/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T11:24:01.312 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-10-14T11:24:01.312 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::1861:4b53:bc45:a6ac/64 scope link noprefixroute 2023-10-14T11:24:01.312 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.313 INFO:teuthology.orchestra.run.smithi067.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T11:24:01.313 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 46:66:b4:f4:41:40 brd ff:ff:ff:ff:ff:ff 2023-10-14T11:24:01.313 INFO:teuthology.orchestra.run.smithi067.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T11:24:01.313 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.313 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::58b6:ffff:fe21:1cd9/64 scope link 2023-10-14T11:24:01.314 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.314 INFO:teuthology.orchestra.run.smithi067.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:24:01.314 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether 46:66:b4:f4:41:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:24:01.314 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::4466:b4ff:fef4:4140/64 scope link 2023-10-14T11:24:01.314 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.315 INFO:teuthology.orchestra.run.smithi067.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T11:24:01.315 INFO:teuthology.orchestra.run.smithi067.stdout: link/ether b6:4d:65:7f:23:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:24:01.315 INFO:teuthology.orchestra.run.smithi067.stdout: inet6 fe80::b44d:65ff:fe7f:23c4/64 scope link 2023-10-14T11:24:01.315 INFO:teuthology.orchestra.run.smithi067.stdout: valid_lft forever preferred_lft forever 2023-10-14T11:24:01.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.316 DEBUG:teuthology.orchestra.run.smithi067:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T11:24:01.375 INFO:teuthology.orchestra.run.smithi067.stdout:1 2023-10-14T11:24:01.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.377 DEBUG:teuthology.orchestra.run.smithi067:> route 2023-10-14T11:24:01.436 INFO:teuthology.orchestra.run.smithi067.stdout:Kernel IP routing table 2023-10-14T11:24:01.436 INFO:teuthology.orchestra.run.smithi067.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T11:24:01.436 INFO:teuthology.orchestra.run.smithi067.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T11:24:01.437 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T11:24:01.437 INFO:teuthology.orchestra.run.smithi067.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T11:24:01.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.438 DEBUG:teuthology.orchestra.run.smithi067:> (cd / && exec bash -c ' 2023-10-14T11:24:01.438 DEBUG:teuthology.orchestra.run.smithi067:> set -e 2023-10-14T11:24:01.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T11:24:01.439 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T11:24:01.439 DEBUG:teuthology.orchestra.run.smithi067:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T11:24:01.440 DEBUG:teuthology.orchestra.run.smithi067:> ') 2023-10-14T11:24:01.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.543 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:24:01.560 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:24:01.561 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:24:01.561 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:24:01.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.562 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link set brx.0 up 2023-10-14T11:24:01.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:24:01.629 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T11:24:01.686 INFO:teuthology.orchestra.run.smithi067.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T11:24:01.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T11:24:01.687 DEBUG:teuthology.orchestra.run.smithi067:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:24:01.743 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-14T11:24:01.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:01.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:24:01.831 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:24:01.832 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:24:01.861 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:24:01.862 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:24:01.862 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:24:01.862 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:24:01.862 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:24:01.863 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:24:01.863 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:24:01.863 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:24:01.916 INFO:teuthology.orchestra.run.smithi067.stderr:mount error 2 = No such file or directory 2023-10-14T11:24:01.917 INFO:teuthology.orchestra.run.smithi067.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-14T11:24:01.917 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-14T11:24:01.917 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:3300,172.21.15.72:3300,172.21.15.72:3301" 2023-10-14T11:24:01.917 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with new device syntax: 0@c6e5b03d-6480-4879-8e8f-035e52bef8e2.cephfs=/ 2023-10-14T11:24:01.918 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.67:3300/172.21.15.72:3300/172.21.15.72:3301" will pass to kernel 2023-10-14T11:24:01.918 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: v2 mount support check returned 2 2023-10-14T11:24:01.918 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-14T11:24:01.918 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-14T11:24:01.919 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: resolved to: "172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790" 2023-10-14T11:24:01.919 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.67:6789,172.21.15.72:6789,172.21.15.72:6790:/ 2023-10-14T11:24:01.919 INFO:teuthology.orchestra.run.smithi067.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c6e5b03d-6480-4879-8e8f-035e52bef8e2" will pass to kernel 2023-10-14T11:24:01.920 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-14T11:24:01.920 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-10-14T11:24:01.921 INFO:tasks.cephfs_test_runner:test: ... ERROR 2023-10-14T11:24:01.922 INFO:tasks.cephfs_test_runner: 2023-10-14T11:24:01.922 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T11:24:01.922 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-10-14T11:24:01.923 INFO:tasks.cephfs_test_runner:test: 2023-10-14T11:24:01.923 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:24:01.923 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T11:24:01.923 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T11:24:01.924 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T11:24:01.924 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T11:24:01.924 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T11:24:01.924 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T11:24:01.925 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T11:24:01.925 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T11:24:01.925 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T11:24:01.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T11:24:01.926 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T11:24:01.926 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T11:24:01.926 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T11:24:01.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T11:24:01.927 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T11:24:01.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T11:24:01.928 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T11:24:01.928 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T11:24:01.928 INFO:tasks.cephfs_test_runner: 2023-10-14T11:24:01.928 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:24:01.929 INFO:tasks.cephfs_test_runner:Ran 1 test in 33.877s 2023-10-14T11:24:01.929 INFO:tasks.cephfs_test_runner: 2023-10-14T11:24:01.929 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-14T11:24:01.930 INFO:tasks.cephfs_test_runner: 2023-10-14T11:24:01.930 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T11:24:01.930 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-10-14T11:24:01.931 INFO:tasks.cephfs_test_runner:test: 2023-10-14T11:24:01.931 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T11:24:01.931 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T11:24:01.931 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/cephfs_test_case.py", line 184, in setUp 2023-10-14T11:24:01.932 INFO:tasks.cephfs_test_runner: self.mounts[i].mount_wait() 2023-10-14T11:24:01.932 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/mount.py", line 505, in mount_wait 2023-10-14T11:24:01.932 INFO:tasks.cephfs_test_runner: self.mount(**kwargs) 2023-10-14T11:24:01.932 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 59, in mount 2023-10-14T11:24:01.933 INFO:tasks.cephfs_test_runner: retval = self._run_mount_cmd(mntopts, check_status) 2023-10-14T11:24:01.933 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/kernel_mount.py", line 83, in _run_mount_cmd 2023-10-14T11:24:01.933 INFO:tasks.cephfs_test_runner: self.client_remote.run(args=mount_cmd, timeout=300, 2023-10-14T11:24:01.933 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-14T11:24:01.934 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-14T11:24:01.934 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run 2023-10-14T11:24:01.934 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-14T11:24:01.935 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait 2023-10-14T11:24:01.935 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-14T11:24:01.935 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-14T11:24:01.935 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-14T11:24:01.936 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback' 2023-10-14T11:24:01.936 INFO:tasks.cephfs_test_runner: 2023-10-14T11:24:01.936 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-10-14T11:24:02.000 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=943140a9820c481388fef6513a736b51 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-10-14T11:24:02.002 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T11:24:02.012 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-14T11:24:02.059 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-14T11:24:02.060 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:24:02.060 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:24:02.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284288k,nr_inodes=4071072,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T11:24:02.106 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2023-10-14T11:24:02.106 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:24:02.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284288k,nr_inodes=4071072,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20642 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-10-14T11:24:02.164 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:24:02.165 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:24:02.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T11:24:02.187 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-10-14T11:24:02.187 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T11:24:02.246 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=432 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-10-14T11:24:02.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.247 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:24:02.264 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T11:24:02.265 INFO:teuthology.orchestra.run.smithi067.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T11:24:02.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.265 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T11:24:02.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.342 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T11:24:02.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.433 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-14T11:24:02.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.536 DEBUG:teuthology.orchestra.run.smithi067:> ip netns list 2023-10-14T11:24:02.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.554 DEBUG:teuthology.orchestra.run.smithi067:> sudo ip link delete ceph-brx 2023-10-14T11:24:02.624 INFO:teuthology.orchestra.run.smithi067.stderr:Cannot find device "ceph-brx" 2023-10-14T11:24:02.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:24:02.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.626 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:24:02.647 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T11:24:02.647 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T11:24:02.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T11:24:02.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T11:24:02.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T11:24:02.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.924 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-10-14T11:24:02.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T11:24:02.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-10-14T11:24:03.012 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2023-10-14T11:24:03.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:24:03.014 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T11:24:03.024 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T11:24:03.024 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:03.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.148+0000 7fbdd5ea7700 1 Processor -- start 2023-10-14T11:24:03.151 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.148+0000 7fbdd5ea7700 1 -- start start 2023-10-14T11:24:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdd5ea7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbdd015b750 0x7fbdd00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdd5ea7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbdd015f390 0x7fbdd006a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdd5ea7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00c9fc0 con 0x7fbdd0071540 2023-10-14T11:24:03.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdd5ea7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00cbcb0 con 0x7fbdd015f390 2023-10-14T11:24:03.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdd5ea7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd015f890 con 0x7fbdd015b750 2023-10-14T11:24:03.155 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fbdd015f390 0x7fbdd006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdcffff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fbdd0071540 0x7fbdd00cc100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42566/0 (socket says 172.21.15.67:42566) 2023-10-14T11:24:03.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdcffff700 1 -- 172.21.15.67:0/4201350155 learned_addr learned my addr 172.21.15.67:0/4201350155 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:03.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 -- 172.21.15.67:0/4201350155 >> v2:172.21.15.72:3300/0 conn(0x7fbdd015b750 msgr2=0x7fbdd00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:03.156 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 --2- 172.21.15.67:0/4201350155 >> v2:172.21.15.72:3300/0 conn(0x7fbdd015b750 0x7fbdd00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 -- 172.21.15.67:0/4201350155 >> v1:172.21.15.67:6789/0 conn(0x7fbdd0071540 legacy=0x7fbdd00cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 -- 172.21.15.67:0/4201350155 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd015fb70 con 0x7fbdd015f390 2023-10-14T11:24:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdce7fc700 1 -- 172.21.15.67:0/4201350155 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927167175 0 0) 0x7fbdd00c9fc0 con 0x7fbdd0071540 2023-10-14T11:24:03.157 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdceffd700 1 --2- 172.21.15.67:0/4201350155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd006a810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdd006e700 tx=0x7fbdc4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451a6f15007d288d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdce7fc700 1 -- 172.21.15.67:0/4201350155 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011830 con 0x7fbdd015f390 2023-10-14T11:24:03.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdce7fc700 1 -- 172.21.15.67:0/4201350155 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4011990 con 0x7fbdd015f390 2023-10-14T11:24:03.158 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.149+0000 7fbdce7fc700 1 -- 172.21.15.67:0/4201350155 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4011d20 con 0x7fbdd015f390 2023-10-14T11:24:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/4201350155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 msgr2=0x7fbdd006a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/4201350155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd006a810 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbdd006e700 tx=0x7fbdc4009b20 comp rx=0 tx=0).stop 2023-10-14T11:24:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/4201350155 shutdown_connections 2023-10-14T11:24:03.159 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/4201350155 >> v2:172.21.15.72:3300/0 conn(0x7fbdd015b750 0x7fbdd00c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/4201350155 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd006a810 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/4201350155 >> 172.21.15.67:0/4201350155 conn(0x7fbdd00b0f60 msgr2=0x7fbdd00b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:03.160 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/4201350155 shutdown_connections 2023-10-14T11:24:03.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.150+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/4201350155 wait complete. 2023-10-14T11:24:03.161 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.151+0000 7fbdd5ea7700 1 Processor -- start 2023-10-14T11:24:03.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.151+0000 7fbdd5ea7700 1 -- start start 2023-10-14T11:24:03.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 0x7fbdd0157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.164 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 0x7fbdd0158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0158200 con 0x7fbdd015f390 2023-10-14T11:24:03.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01515b0 con 0x7fbdd015b750 2023-10-14T11:24:03.165 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdd5ea7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0157860 con 0x7fbdd0071540 2023-10-14T11:24:03.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdcffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43278/0 (socket says 172.21.15.67:43278) 2023-10-14T11:24:03.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.152+0000 7fbdcffff700 1 -- 172.21.15.67:0/1331653203 learned_addr learned my addr 172.21.15.67:0/1331653203 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:03.166 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdceffd700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 0x7fbdd0158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 -- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 msgr2=0x7fbdd0157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcf7fe700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 0x7fbdd0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 0x7fbdd0157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 -- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 msgr2=0x7fbdd0158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 0x7fbdd0158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 -- 172.21.15.67:0/1331653203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc40094a0 con 0x7fbdd015f390 2023-10-14T11:24:03.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdceffd700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 0x7fbdd0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:03.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcf7fe700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 0x7fbdd0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:03.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdcffff700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800cc10 tx=0x7fbdc800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800abb0 con 0x7fbdd015f390 2023-10-14T11:24:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800ad10 con 0x7fbdd015f390 2023-10-14T11:24:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0157b40 con 0x7fbdd015f390 2023-10-14T11:24:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007310 con 0x7fbdd015f390 2023-10-14T11:24:03.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.153+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd0150e80 con 0x7fbdd015f390 2023-10-14T11:24:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.154+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd0158b60 con 0x7fbdd015f390 2023-10-14T11:24:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.154+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbdc8007470 con 0x7fbdd015f390 2023-10-14T11:24:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.155+0000 7fbdb7fff700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.155+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fbdc8089360 con 0x7fbdd015f390 2023-10-14T11:24:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.155+0000 7fbdcf7fe700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.156+0000 7fbdcf7fe700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0159240 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.159+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbdc8054480 con 0x7fbdd015f390 2023-10-14T11:24:03.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.356+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdd0160130 con 0x7fbdbc06af00 2023-10-14T11:24:03.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.365+0000 7fbdb7fff700 1 -- 172.21.15.67:0/1331653203 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289122 (secure 0 0 0) 0x7fbdc00075a0 con 0x7fbdbc06af00 2023-10-14T11:24:03.371 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 msgr2=0x7fbdbc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0159240 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2023-10-14T11:24:03.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 msgr2=0x7fbdd014fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800cc10 tx=0x7fbdc800a060 comp rx=0 tx=0).stop 2023-10-14T11:24:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 shutdown_connections 2023-10-14T11:24:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fbdbc06af00 0x7fbdbc06d3c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.375 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fbdd015f390 0x7fbdd014fe90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fbdd0071540 0x7fbdd0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 --2- 172.21.15.67:0/1331653203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbdd015b750 0x7fbdd0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.376 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 >> 172.21.15.67:0/1331653203 conn(0x7fbdd00b0f60 msgr2=0x7fbdd00b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:03.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 shutdown_connections 2023-10-14T11:24:03.377 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.368+0000 7fbdd5ea7700 1 -- 172.21.15.67:0/1331653203 wait complete. 2023-10-14T11:24:03.377 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:03.384 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T11:24:02.416867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605436+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605436+0000","last_peered":"2023-10-14T11:23:57.605436+0000","last_clean":"2023-10-14T11:23:57.605436+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605436+0000","last_undegraded":"2023-10-14T11:23:57.605436+0000","last_fullsized":"2023-10-14T11:23:57.605436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881261+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:57.881261+0000","last_peered":"2023-10-14T11:23:57.881261+0000","last_clean":"2023-10-14T11:23:57.881261+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:57.881261+0000","last_undegraded":"2023-10-14T11:23:57.881261+0000","last_fullsized":"2023-10-14T11:23:57.881261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881305+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:57.881305+0000","last_peered":"2023-10-14T11:23:57.881305+0000","last_clean":"2023-10-14T11:23:57.881305+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:57.881305+0000","last_undegraded":"2023-10-14T11:23:57.881305+0000","last_fullsized":"2023-10-14T11:23:57.881305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881869+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:57.881869+0000","last_peered":"2023-10-14T11:23:57.881869+0000","last_clean":"2023-10-14T11:23:57.881869+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:57.881869+0000","last_undegraded":"2023-10-14T11:23:57.881869+0000","last_fullsized":"2023-10-14T11:23:57.881869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881695+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:57.881695+0000","last_peered":"2023-10-14T11:23:57.881695+0000","last_clean":"2023-10-14T11:23:57.881695+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:57.881695+0000","last_undegraded":"2023-10-14T11:23:57.881695+0000","last_fullsized":"2023-10-14T11:23:57.881695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605355+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605355+0000","last_peered":"2023-10-14T11:23:57.605355+0000","last_clean":"2023-10-14T11:23:57.605355+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605355+0000","last_undegraded":"2023-10-14T11:23:57.605355+0000","last_fullsized":"2023-10-14T11:23:57.605355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605377+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605377+0000","last_peered":"2023-10-14T11:23:57.605377+0000","last_clean":"2023-10-14T11:23:57.605377+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605377+0000","last_undegraded":"2023-10-14T11:23:57.605377+0000","last_fullsized":"2023-10-14T11:23:57.605377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881506+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:57.881506+0000","last_peered":"2023-10-14T11:23:57.881506+0000","last_clean":"2023-10-14T11:23:57.881506+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:57.881506+0000","last_undegraded":"2023-10-14T11:23:57.881506+0000","last_fullsized":"2023-10-14T11:23:57.881506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881854+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881854+0000","last_peered":"2023-10-14T11:23:57.881854+0000","last_clean":"2023-10-14T11:23:57.881854+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881854+0000","last_undegraded":"2023-10-14T11:23:57.881854+0000","last_fullsized":"2023-10-14T11:23:57.881854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881368+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:57.881368+0000","last_peered":"2023-10-14T11:23:57.881368+0000","last_clean":"2023-10-14T11:23:57.881368+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:57.881368+0000","last_undegraded":"2023-10-14T11:23:57.881368+0000","last_fullsized":"2023-10-14T11:23:57.881368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882034+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882034+0000","last_peered":"2023-10-14T11:23:57.882034+0000","last_clean":"2023-10-14T11:23:57.882034+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882034+0000","last_undegraded":"2023-10-14T11:23:57.882034+0000","last_fullsized":"2023-10-14T11:23:57.882034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.961946+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:56.961946+0000","last_peered":"2023-10-14T11:23:56.961946+0000","last_clean":"2023-10-14T11:23:56.961946+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:56.961946+0000","last_undegraded":"2023-10-14T11:23:56.961946+0000","last_fullsized":"2023-10-14T11:23:56.961946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605133+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:57.605133+0000","last_peered":"2023-10-14T11:23:57.605133+0000","last_clean":"2023-10-14T11:23:57.605133+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:57.605133+0000","last_undegraded":"2023-10-14T11:23:57.605133+0000","last_fullsized":"2023-10-14T11:23:57.605133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605458+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:57.605458+0000","last_peered":"2023-10-14T11:23:57.605458+0000","last_clean":"2023-10-14T11:23:57.605458+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:57.605458+0000","last_undegraded":"2023-10-14T11:23:57.605458+0000","last_fullsized":"2023-10-14T11:23:57.605458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882087+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:57.882087+0000","last_peered":"2023-10-14T11:23:57.882087+0000","last_clean":"2023-10-14T11:23:57.882087+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:57.882087+0000","last_undegraded":"2023-10-14T11:23:57.882087+0000","last_fullsized":"2023-10-14T11:23:57.882087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881332+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:57.881332+0000","last_peered":"2023-10-14T11:23:57.881332+0000","last_clean":"2023-10-14T11:23:57.881332+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:57.881332+0000","last_undegraded":"2023-10-14T11:23:57.881332+0000","last_fullsized":"2023-10-14T11:23:57.881332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881085+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:57.881085+0000","last_peered":"2023-10-14T11:23:57.881085+0000","last_clean":"2023-10-14T11:23:57.881085+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:57.881085+0000","last_undegraded":"2023-10-14T11:23:57.881085+0000","last_fullsized":"2023-10-14T11:23:57.881085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962188+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:56.962188+0000","last_peered":"2023-10-14T11:23:56.962188+0000","last_clean":"2023-10-14T11:23:56.962188+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:56.962188+0000","last_undegraded":"2023-10-14T11:23:56.962188+0000","last_fullsized":"2023-10-14T11:23:56.962188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471268+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:56.471268+0000","last_peered":"2023-10-14T11:23:56.471268+0000","last_clean":"2023-10-14T11:23:56.471268+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:56.471268+0000","last_undegraded":"2023-10-14T11:23:56.471268+0000","last_fullsized":"2023-10-14T11:23:56.471268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881656+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881656+0000","last_peered":"2023-10-14T11:23:57.881656+0000","last_clean":"2023-10-14T11:23:57.881656+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881656+0000","last_undegraded":"2023-10-14T11:23:57.881656+0000","last_fullsized":"2023-10-14T11:23:57.881656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881483+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881483+0000","last_peered":"2023-10-14T11:23:57.881483+0000","last_clean":"2023-10-14T11:23:57.881483+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881483+0000","last_undegraded":"2023-10-14T11:23:57.881483+0000","last_fullsized":"2023-10-14T11:23:57.881483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466998+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:56.466998+0000","last_peered":"2023-10-14T11:23:56.466998+0000","last_clean":"2023-10-14T11:23:56.466998+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:56.466998+0000","last_undegraded":"2023-10-14T11:23:56.466998+0000","last_fullsized":"2023-10-14T11:23:56.466998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605354+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605354+0000","last_peered":"2023-10-14T11:23:57.605354+0000","last_clean":"2023-10-14T11:23:57.605354+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605354+0000","last_undegraded":"2023-10-14T11:23:57.605354+0000","last_fullsized":"2023-10-14T11:23:57.605354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466904+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:56.466904+0000","last_peered":"2023-10-14T11:23:56.466904+0000","last_clean":"2023-10-14T11:23:56.466904+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:56.466904+0000","last_undegraded":"2023-10-14T11:23:56.466904+0000","last_fullsized":"2023-10-14T11:23:56.466904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881917+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:57.881917+0000","last_peered":"2023-10-14T11:23:57.881917+0000","last_clean":"2023-10-14T11:23:57.881917+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:57.881917+0000","last_undegraded":"2023-10-14T11:23:57.881917+0000","last_fullsized":"2023-10-14T11:23:57.881917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466768+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:56.466768+0000","last_peered":"2023-10-14T11:23:56.466768+0000","last_clean":"2023-10-14T11:23:56.466768+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:56.466768+0000","last_undegraded":"2023-10-14T11:23:56.466768+0000","last_fullsized":"2023-10-14T11:23:56.466768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605582+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605582+0000","last_peered":"2023-10-14T11:23:57.605582+0000","last_clean":"2023-10-14T11:23:57.605582+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605582+0000","last_undegraded":"2023-10-14T11:23:57.605582+0000","last_fullsized":"2023-10-14T11:23:57.605582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471278+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:56.471278+0000","last_peered":"2023-10-14T11:23:56.471278+0000","last_clean":"2023-10-14T11:23:56.471278+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:56.471278+0000","last_undegraded":"2023-10-14T11:23:56.471278+0000","last_fullsized":"2023-10-14T11:23:56.471278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466952+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:56.466952+0000","last_peered":"2023-10-14T11:23:56.466952+0000","last_clean":"2023-10-14T11:23:56.466952+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:56.466952+0000","last_undegraded":"2023-10-14T11:23:56.466952+0000","last_fullsized":"2023-10-14T11:23:56.466952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605437+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605437+0000","last_peered":"2023-10-14T11:23:57.605437+0000","last_clean":"2023-10-14T11:23:57.605437+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605437+0000","last_undegraded":"2023-10-14T11:23:57.605437+0000","last_fullsized":"2023-10-14T11:23:57.605437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466951+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:56.466951+0000","last_peered":"2023-10-14T11:23:56.466951+0000","last_clean":"2023-10-14T11:23:56.466951+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:56.466951+0000","last_undegraded":"2023-10-14T11:23:56.466951+0000","last_fullsized":"2023-10-14T11:23:56.466951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881653+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881653+0000","last_peered":"2023-10-14T11:23:57.881653+0000","last_clean":"2023-10-14T11:23:57.881653+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881653+0000","last_undegraded":"2023-10-14T11:23:57.881653+0000","last_fullsized":"2023-10-14T11:23:57.881653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881694+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:57.881694+0000","last_peered":"2023-10-14T11:23:57.881694+0000","last_clean":"2023-10-14T11:23:57.881694+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:57.881694+0000","last_undegraded":"2023-10-14T11:23:57.881694+0000","last_fullsized":"2023-10-14T11:23:57.881694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605690+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605690+0000","last_peered":"2023-10-14T11:23:57.605690+0000","last_clean":"2023-10-14T11:23:57.605690+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605690+0000","last_undegraded":"2023-10-14T11:23:57.605690+0000","last_fullsized":"2023-10-14T11:23:57.605690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467101+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:56.467101+0000","last_peered":"2023-10-14T11:23:56.467101+0000","last_clean":"2023-10-14T11:23:56.467101+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:56.467101+0000","last_undegraded":"2023-10-14T11:23:56.467101+0000","last_fullsized":"2023-10-14T11:23:56.467101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467061+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:56.467061+0000","last_peered":"2023-10-14T11:23:56.467061+0000","last_clean":"2023-10-14T11:23:56.467061+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:56.467061+0000","last_undegraded":"2023-10-14T11:23:56.467061+0000","last_fullsized":"2023-10-14T11:23:56.467061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467037+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:56.467037+0000","last_peered":"2023-10-14T11:23:56.467037+0000","last_clean":"2023-10-14T11:23:56.467037+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:56.467037+0000","last_undegraded":"2023-10-14T11:23:56.467037+0000","last_fullsized":"2023-10-14T11:23:56.467037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471219+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:56.471219+0000","last_peered":"2023-10-14T11:23:56.471219+0000","last_clean":"2023-10-14T11:23:56.471219+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:56.471219+0000","last_undegraded":"2023-10-14T11:23:56.471219+0000","last_fullsized":"2023-10-14T11:23:56.471219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466847+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:56.466847+0000","last_peered":"2023-10-14T11:23:56.466847+0000","last_clean":"2023-10-14T11:23:56.466847+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:56.466847+0000","last_undegraded":"2023-10-14T11:23:56.466847+0000","last_fullsized":"2023-10-14T11:23:56.466847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881382+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881382+0000","last_peered":"2023-10-14T11:23:57.881382+0000","last_clean":"2023-10-14T11:23:57.881382+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881382+0000","last_undegraded":"2023-10-14T11:23:57.881382+0000","last_fullsized":"2023-10-14T11:23:57.881382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466801+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:56.466801+0000","last_peered":"2023-10-14T11:23:56.466801+0000","last_clean":"2023-10-14T11:23:56.466801+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:56.466801+0000","last_undegraded":"2023-10-14T11:23:56.466801+0000","last_fullsized":"2023-10-14T11:23:56.466801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605585+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605585+0000","last_peered":"2023-10-14T11:23:57.605585+0000","last_clean":"2023-10-14T11:23:57.605585+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605585+0000","last_undegraded":"2023-10-14T11:23:57.605585+0000","last_fullsized":"2023-10-14T11:23:57.605585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962355+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:56.962355+0000","last_peered":"2023-10-14T11:23:56.962355+0000","last_clean":"2023-10-14T11:23:56.962355+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:56.962355+0000","last_undegraded":"2023-10-14T11:23:56.962355+0000","last_fullsized":"2023-10-14T11:23:56.962355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962185+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:56.962185+0000","last_peered":"2023-10-14T11:23:56.962185+0000","last_clean":"2023-10-14T11:23:56.962185+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:56.962185+0000","last_undegraded":"2023-10-14T11:23:56.962185+0000","last_fullsized":"2023-10-14T11:23:56.962185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471206+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:56.471206+0000","last_peered":"2023-10-14T11:23:56.471206+0000","last_clean":"2023-10-14T11:23:56.471206+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:56.471206+0000","last_undegraded":"2023-10-14T11:23:56.471206+0000","last_fullsized":"2023-10-14T11:23:56.471206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962295+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:56.962295+0000","last_peered":"2023-10-14T11:23:56.962295+0000","last_clean":"2023-10-14T11:23:56.962295+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:56.962295+0000","last_undegraded":"2023-10-14T11:23:56.962295+0000","last_fullsized":"2023-10-14T11:23:56.962295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466866+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:56.466866+0000","last_peered":"2023-10-14T11:23:56.466866+0000","last_clean":"2023-10-14T11:23:56.466866+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:56.466866+0000","last_undegraded":"2023-10-14T11:23:56.466866+0000","last_fullsized":"2023-10-14T11:23:56.466866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881246+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:57.881246+0000","last_peered":"2023-10-14T11:23:57.881246+0000","last_clean":"2023-10-14T11:23:57.881246+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:57.881246+0000","last_undegraded":"2023-10-14T11:23:57.881246+0000","last_fullsized":"2023-10-14T11:23:57.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881460+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881460+0000","last_peered":"2023-10-14T11:23:57.881460+0000","last_clean":"2023-10-14T11:23:57.881460+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881460+0000","last_undegraded":"2023-10-14T11:23:57.881460+0000","last_fullsized":"2023-10-14T11:23:57.881460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.846831+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:54.846831+0000","last_peered":"2023-10-14T11:23:54.846831+0000","last_clean":"2023-10-14T11:23:54.846831+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:54.846831+0000","last_undegraded":"2023-10-14T11:23:54.846831+0000","last_fullsized":"2023-10-14T11:23:54.846831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54800000000000004}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.625}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36599999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.72199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.308}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.439},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.77300000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.628},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82299999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:03.390 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:03.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.546+0000 7fe0ef01d700 1 Processor -- start 2023-10-14T11:24:03.549 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.546+0000 7fe0ef01d700 1 -- start start 2023-10-14T11:24:03.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ef01d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e806d260 0x7fe0e81618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ef01d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0e8161e10 0x7fe0e815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.552 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ef01d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e806d6e0 con 0x7fe0e815def0 2023-10-14T11:24:03.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ef01d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e81622a0 con 0x7fe0e8161e10 2023-10-14T11:24:03.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ef01d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e806cdd0 con 0x7fe0e806d260 2023-10-14T11:24:03.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fe0e8161e10 0x7fe0e815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.553 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ecdb9700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe0e815def0 0x7fe0e80cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42578/0 (socket says 172.21.15.67:42578) 2023-10-14T11:24:03.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ecdb9700 1 -- 172.21.15.67:0/1837247894 learned_addr learned my addr 172.21.15.67:0/1837247894 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:03.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0e7fff700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e806d260 0x7fe0e81618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.554 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 -- 172.21.15.67:0/1837247894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e806d260 msgr2=0x7fe0e81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:03.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e806d260 0x7fe0e81618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 -- 172.21.15.67:0/1837247894 >> v1:172.21.15.67:6789/0 conn(0x7fe0e815def0 legacy=0x7fe0e80cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 -- 172.21.15.67:0/1837247894 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e806c1c0 con 0x7fe0e8161e10 2023-10-14T11:24:03.555 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0e77fe700 1 -- 172.21.15.67:0/1837247894 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670290789 0 0) 0x7fe0dc001110 con 0x7fe0e815def0 2023-10-14T11:24:03.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.547+0000 7fe0ed5ba700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e8161e10 0x7fe0e815f6d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009d90 tx=0x7fe0e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2aeb81e6edf2d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0e77fe700 1 -- 172.21.15.67:0/1837247894 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000e070 con 0x7fe0e8161e10 2023-10-14T11:24:03.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0e77fe700 1 -- 172.21.15.67:0/1837247894 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e000bbd0 con 0x7fe0e8161e10 2023-10-14T11:24:03.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0e77fe700 1 -- 172.21.15.67:0/1837247894 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0012430 con 0x7fe0e8161e10 2023-10-14T11:24:03.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 -- 172.21.15.67:0/1837247894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e8161e10 msgr2=0x7fe0e815f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e8161e10 0x7fe0e815f6d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009d90 tx=0x7fe0e000b330 comp rx=0 tx=0).stop 2023-10-14T11:24:03.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 -- 172.21.15.67:0/1837247894 shutdown_connections 2023-10-14T11:24:03.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e8161e10 0x7fe0e815f6d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/1837247894 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e806d260 0x7fe0e81618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 -- 172.21.15.67:0/1837247894 >> 172.21.15.67:0/1837247894 conn(0x7fe0e80d1570 msgr2=0x7fe0e80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:03.558 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 -- 172.21.15.67:0/1837247894 shutdown_connections 2023-10-14T11:24:03.559 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.548+0000 7fe0ef01d700 1 -- 172.21.15.67:0/1837247894 wait complete. 2023-10-14T11:24:03.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.549+0000 7fe0ef01d700 1 Processor -- start 2023-10-14T11:24:03.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.549+0000 7fe0ef01d700 1 -- start start 2023-10-14T11:24:03.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e815def0 0x7fe0e80c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e8161e10 0x7fe0e80b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c7f60 con 0x7fe0e806d260 2023-10-14T11:24:03.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c8380 con 0x7fe0e8161e10 2023-10-14T11:24:03.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ef01d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8155e60 con 0x7fe0e815def0 2023-10-14T11:24:03.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ecdb9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ecdb9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43290/0 (socket says 172.21.15.67:43290) 2023-10-14T11:24:03.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.550+0000 7fe0ecdb9700 1 -- 172.21.15.67:0/3502975956 learned_addr learned my addr 172.21.15.67:0/3502975956 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:03.564 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0e7fff700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e815def0 0x7fe0e80c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ed5ba700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e8161e10 0x7fe0e80b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 -- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e815def0 msgr2=0x7fe0e80c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e815def0 0x7fe0e80c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 -- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e8161e10 msgr2=0x7fe0e80b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e8161e10 0x7fe0e80b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 -- 172.21.15.67:0/3502975956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009a70 con 0x7fe0e806d260 2023-10-14T11:24:03.566 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ecdb9700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c730 tx=0x7fe0dc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc004c80 con 0x7fe0e806d260 2023-10-14T11:24:03.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc004e00 con 0x7fe0e806d260 2023-10-14T11:24:03.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80c72e0 con 0x7fe0e806d260 2023-10-14T11:24:03.567 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc007310 con 0x7fe0e806d260 2023-10-14T11:24:03.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.551+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80c78a0 con 0x7fe0e806d260 2023-10-14T11:24:03.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.552+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e80c80a0 con 0x7fe0e806d260 2023-10-14T11:24:03.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.552+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0dc007470 con 0x7fe0e806d260 2023-10-14T11:24:03.568 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.553+0000 7fe0e57fa700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 0x7fe0cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.553+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe0dc0890a0 con 0x7fe0e806d260 2023-10-14T11:24:03.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.553+0000 7fe0e7fff700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 0x7fe0cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.569 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.553+0000 7fe0e7fff700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 0x7fe0cc06d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0e815ceb0 tx=0x7fe0d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.570 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.557+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0dc0541c0 con 0x7fe0e806d260 2023-10-14T11:24:03.756 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.753+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0e80c4f30 con 0x7fe0cc06af00 2023-10-14T11:24:03.764 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.762+0000 7fe0e57fa700 1 -- 172.21.15.67:0/3502975956 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289122 (secure 0 0 0) 0x7fe0e80c4f30 con 0x7fe0cc06af00 2023-10-14T11:24:03.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:03.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 msgr2=0x7fe0cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 0x7fe0cc06d3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0e815ceb0 tx=0x7fe0d4008040 comp rx=0 tx=0).stop 2023-10-14T11:24:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 msgr2=0x7fe0e8155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c730 tx=0x7fe0dc00ca40 comp rx=0 tx=0).stop 2023-10-14T11:24:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 shutdown_connections 2023-10-14T11:24:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0e8161e10 0x7fe0e80b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe0cc06af00 0x7fe0cc06d3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe0e806d260 0x7fe0e8155920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 --2- 172.21.15.67:0/3502975956 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe0e815def0 0x7fe0e80c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 >> 172.21.15.67:0/3502975956 conn(0x7fe0e80d1570 msgr2=0x7fe0e8158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:03.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 shutdown_connections 2023-10-14T11:24:03.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.765+0000 7fe0ef01d700 1 -- 172.21.15.67:0/3502975956 wait complete. 2023-10-14T11:24:03.774 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:03.780 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T11:24:02.416867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605436+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605436+0000","last_peered":"2023-10-14T11:23:57.605436+0000","last_clean":"2023-10-14T11:23:57.605436+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605436+0000","last_undegraded":"2023-10-14T11:23:57.605436+0000","last_fullsized":"2023-10-14T11:23:57.605436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881261+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:57.881261+0000","last_peered":"2023-10-14T11:23:57.881261+0000","last_clean":"2023-10-14T11:23:57.881261+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:57.881261+0000","last_undegraded":"2023-10-14T11:23:57.881261+0000","last_fullsized":"2023-10-14T11:23:57.881261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881305+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:57.881305+0000","last_peered":"2023-10-14T11:23:57.881305+0000","last_clean":"2023-10-14T11:23:57.881305+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:57.881305+0000","last_undegraded":"2023-10-14T11:23:57.881305+0000","last_fullsized":"2023-10-14T11:23:57.881305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881869+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:57.881869+0000","last_peered":"2023-10-14T11:23:57.881869+0000","last_clean":"2023-10-14T11:23:57.881869+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:57.881869+0000","last_undegraded":"2023-10-14T11:23:57.881869+0000","last_fullsized":"2023-10-14T11:23:57.881869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881695+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:57.881695+0000","last_peered":"2023-10-14T11:23:57.881695+0000","last_clean":"2023-10-14T11:23:57.881695+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:57.881695+0000","last_undegraded":"2023-10-14T11:23:57.881695+0000","last_fullsized":"2023-10-14T11:23:57.881695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605355+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605355+0000","last_peered":"2023-10-14T11:23:57.605355+0000","last_clean":"2023-10-14T11:23:57.605355+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605355+0000","last_undegraded":"2023-10-14T11:23:57.605355+0000","last_fullsized":"2023-10-14T11:23:57.605355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605377+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605377+0000","last_peered":"2023-10-14T11:23:57.605377+0000","last_clean":"2023-10-14T11:23:57.605377+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605377+0000","last_undegraded":"2023-10-14T11:23:57.605377+0000","last_fullsized":"2023-10-14T11:23:57.605377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881506+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:57.881506+0000","last_peered":"2023-10-14T11:23:57.881506+0000","last_clean":"2023-10-14T11:23:57.881506+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:57.881506+0000","last_undegraded":"2023-10-14T11:23:57.881506+0000","last_fullsized":"2023-10-14T11:23:57.881506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881854+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881854+0000","last_peered":"2023-10-14T11:23:57.881854+0000","last_clean":"2023-10-14T11:23:57.881854+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881854+0000","last_undegraded":"2023-10-14T11:23:57.881854+0000","last_fullsized":"2023-10-14T11:23:57.881854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881368+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:57.881368+0000","last_peered":"2023-10-14T11:23:57.881368+0000","last_clean":"2023-10-14T11:23:57.881368+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:57.881368+0000","last_undegraded":"2023-10-14T11:23:57.881368+0000","last_fullsized":"2023-10-14T11:23:57.881368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882034+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882034+0000","last_peered":"2023-10-14T11:23:57.882034+0000","last_clean":"2023-10-14T11:23:57.882034+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882034+0000","last_undegraded":"2023-10-14T11:23:57.882034+0000","last_fullsized":"2023-10-14T11:23:57.882034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.961946+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:56.961946+0000","last_peered":"2023-10-14T11:23:56.961946+0000","last_clean":"2023-10-14T11:23:56.961946+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:56.961946+0000","last_undegraded":"2023-10-14T11:23:56.961946+0000","last_fullsized":"2023-10-14T11:23:56.961946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605133+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:57.605133+0000","last_peered":"2023-10-14T11:23:57.605133+0000","last_clean":"2023-10-14T11:23:57.605133+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:57.605133+0000","last_undegraded":"2023-10-14T11:23:57.605133+0000","last_fullsized":"2023-10-14T11:23:57.605133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605458+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:57.605458+0000","last_peered":"2023-10-14T11:23:57.605458+0000","last_clean":"2023-10-14T11:23:57.605458+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:57.605458+0000","last_undegraded":"2023-10-14T11:23:57.605458+0000","last_fullsized":"2023-10-14T11:23:57.605458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882087+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:57.882087+0000","last_peered":"2023-10-14T11:23:57.882087+0000","last_clean":"2023-10-14T11:23:57.882087+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:57.882087+0000","last_undegraded":"2023-10-14T11:23:57.882087+0000","last_fullsized":"2023-10-14T11:23:57.882087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881332+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:57.881332+0000","last_peered":"2023-10-14T11:23:57.881332+0000","last_clean":"2023-10-14T11:23:57.881332+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:57.881332+0000","last_undegraded":"2023-10-14T11:23:57.881332+0000","last_fullsized":"2023-10-14T11:23:57.881332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881085+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:57.881085+0000","last_peered":"2023-10-14T11:23:57.881085+0000","last_clean":"2023-10-14T11:23:57.881085+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:57.881085+0000","last_undegraded":"2023-10-14T11:23:57.881085+0000","last_fullsized":"2023-10-14T11:23:57.881085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962188+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:56.962188+0000","last_peered":"2023-10-14T11:23:56.962188+0000","last_clean":"2023-10-14T11:23:56.962188+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:56.962188+0000","last_undegraded":"2023-10-14T11:23:56.962188+0000","last_fullsized":"2023-10-14T11:23:56.962188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471268+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:56.471268+0000","last_peered":"2023-10-14T11:23:56.471268+0000","last_clean":"2023-10-14T11:23:56.471268+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:56.471268+0000","last_undegraded":"2023-10-14T11:23:56.471268+0000","last_fullsized":"2023-10-14T11:23:56.471268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881656+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881656+0000","last_peered":"2023-10-14T11:23:57.881656+0000","last_clean":"2023-10-14T11:23:57.881656+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881656+0000","last_undegraded":"2023-10-14T11:23:57.881656+0000","last_fullsized":"2023-10-14T11:23:57.881656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881483+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881483+0000","last_peered":"2023-10-14T11:23:57.881483+0000","last_clean":"2023-10-14T11:23:57.881483+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881483+0000","last_undegraded":"2023-10-14T11:23:57.881483+0000","last_fullsized":"2023-10-14T11:23:57.881483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466998+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:56.466998+0000","last_peered":"2023-10-14T11:23:56.466998+0000","last_clean":"2023-10-14T11:23:56.466998+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:56.466998+0000","last_undegraded":"2023-10-14T11:23:56.466998+0000","last_fullsized":"2023-10-14T11:23:56.466998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605354+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605354+0000","last_peered":"2023-10-14T11:23:57.605354+0000","last_clean":"2023-10-14T11:23:57.605354+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605354+0000","last_undegraded":"2023-10-14T11:23:57.605354+0000","last_fullsized":"2023-10-14T11:23:57.605354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466904+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:56.466904+0000","last_peered":"2023-10-14T11:23:56.466904+0000","last_clean":"2023-10-14T11:23:56.466904+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:56.466904+0000","last_undegraded":"2023-10-14T11:23:56.466904+0000","last_fullsized":"2023-10-14T11:23:56.466904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881917+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:57.881917+0000","last_peered":"2023-10-14T11:23:57.881917+0000","last_clean":"2023-10-14T11:23:57.881917+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:57.881917+0000","last_undegraded":"2023-10-14T11:23:57.881917+0000","last_fullsized":"2023-10-14T11:23:57.881917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466768+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:56.466768+0000","last_peered":"2023-10-14T11:23:56.466768+0000","last_clean":"2023-10-14T11:23:56.466768+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:56.466768+0000","last_undegraded":"2023-10-14T11:23:56.466768+0000","last_fullsized":"2023-10-14T11:23:56.466768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605582+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605582+0000","last_peered":"2023-10-14T11:23:57.605582+0000","last_clean":"2023-10-14T11:23:57.605582+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605582+0000","last_undegraded":"2023-10-14T11:23:57.605582+0000","last_fullsized":"2023-10-14T11:23:57.605582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471278+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:56.471278+0000","last_peered":"2023-10-14T11:23:56.471278+0000","last_clean":"2023-10-14T11:23:56.471278+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:56.471278+0000","last_undegraded":"2023-10-14T11:23:56.471278+0000","last_fullsized":"2023-10-14T11:23:56.471278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466952+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:56.466952+0000","last_peered":"2023-10-14T11:23:56.466952+0000","last_clean":"2023-10-14T11:23:56.466952+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:56.466952+0000","last_undegraded":"2023-10-14T11:23:56.466952+0000","last_fullsized":"2023-10-14T11:23:56.466952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605437+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605437+0000","last_peered":"2023-10-14T11:23:57.605437+0000","last_clean":"2023-10-14T11:23:57.605437+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605437+0000","last_undegraded":"2023-10-14T11:23:57.605437+0000","last_fullsized":"2023-10-14T11:23:57.605437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466951+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:56.466951+0000","last_peered":"2023-10-14T11:23:56.466951+0000","last_clean":"2023-10-14T11:23:56.466951+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:56.466951+0000","last_undegraded":"2023-10-14T11:23:56.466951+0000","last_fullsized":"2023-10-14T11:23:56.466951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881653+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881653+0000","last_peered":"2023-10-14T11:23:57.881653+0000","last_clean":"2023-10-14T11:23:57.881653+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881653+0000","last_undegraded":"2023-10-14T11:23:57.881653+0000","last_fullsized":"2023-10-14T11:23:57.881653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881694+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:57.881694+0000","last_peered":"2023-10-14T11:23:57.881694+0000","last_clean":"2023-10-14T11:23:57.881694+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:57.881694+0000","last_undegraded":"2023-10-14T11:23:57.881694+0000","last_fullsized":"2023-10-14T11:23:57.881694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605690+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605690+0000","last_peered":"2023-10-14T11:23:57.605690+0000","last_clean":"2023-10-14T11:23:57.605690+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605690+0000","last_undegraded":"2023-10-14T11:23:57.605690+0000","last_fullsized":"2023-10-14T11:23:57.605690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467101+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:56.467101+0000","last_peered":"2023-10-14T11:23:56.467101+0000","last_clean":"2023-10-14T11:23:56.467101+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:56.467101+0000","last_undegraded":"2023-10-14T11:23:56.467101+0000","last_fullsized":"2023-10-14T11:23:56.467101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467061+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:56.467061+0000","last_peered":"2023-10-14T11:23:56.467061+0000","last_clean":"2023-10-14T11:23:56.467061+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:56.467061+0000","last_undegraded":"2023-10-14T11:23:56.467061+0000","last_fullsized":"2023-10-14T11:23:56.467061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467037+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:56.467037+0000","last_peered":"2023-10-14T11:23:56.467037+0000","last_clean":"2023-10-14T11:23:56.467037+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:56.467037+0000","last_undegraded":"2023-10-14T11:23:56.467037+0000","last_fullsized":"2023-10-14T11:23:56.467037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471219+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:56.471219+0000","last_peered":"2023-10-14T11:23:56.471219+0000","last_clean":"2023-10-14T11:23:56.471219+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:56.471219+0000","last_undegraded":"2023-10-14T11:23:56.471219+0000","last_fullsized":"2023-10-14T11:23:56.471219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466847+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:56.466847+0000","last_peered":"2023-10-14T11:23:56.466847+0000","last_clean":"2023-10-14T11:23:56.466847+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:56.466847+0000","last_undegraded":"2023-10-14T11:23:56.466847+0000","last_fullsized":"2023-10-14T11:23:56.466847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881382+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881382+0000","last_peered":"2023-10-14T11:23:57.881382+0000","last_clean":"2023-10-14T11:23:57.881382+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881382+0000","last_undegraded":"2023-10-14T11:23:57.881382+0000","last_fullsized":"2023-10-14T11:23:57.881382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466801+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:56.466801+0000","last_peered":"2023-10-14T11:23:56.466801+0000","last_clean":"2023-10-14T11:23:56.466801+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:56.466801+0000","last_undegraded":"2023-10-14T11:23:56.466801+0000","last_fullsized":"2023-10-14T11:23:56.466801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605585+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605585+0000","last_peered":"2023-10-14T11:23:57.605585+0000","last_clean":"2023-10-14T11:23:57.605585+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605585+0000","last_undegraded":"2023-10-14T11:23:57.605585+0000","last_fullsized":"2023-10-14T11:23:57.605585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962355+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:56.962355+0000","last_peered":"2023-10-14T11:23:56.962355+0000","last_clean":"2023-10-14T11:23:56.962355+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:56.962355+0000","last_undegraded":"2023-10-14T11:23:56.962355+0000","last_fullsized":"2023-10-14T11:23:56.962355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962185+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:56.962185+0000","last_peered":"2023-10-14T11:23:56.962185+0000","last_clean":"2023-10-14T11:23:56.962185+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:56.962185+0000","last_undegraded":"2023-10-14T11:23:56.962185+0000","last_fullsized":"2023-10-14T11:23:56.962185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471206+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:56.471206+0000","last_peered":"2023-10-14T11:23:56.471206+0000","last_clean":"2023-10-14T11:23:56.471206+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:56.471206+0000","last_undegraded":"2023-10-14T11:23:56.471206+0000","last_fullsized":"2023-10-14T11:23:56.471206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962295+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:56.962295+0000","last_peered":"2023-10-14T11:23:56.962295+0000","last_clean":"2023-10-14T11:23:56.962295+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:56.962295+0000","last_undegraded":"2023-10-14T11:23:56.962295+0000","last_fullsized":"2023-10-14T11:23:56.962295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466866+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:56.466866+0000","last_peered":"2023-10-14T11:23:56.466866+0000","last_clean":"2023-10-14T11:23:56.466866+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:56.466866+0000","last_undegraded":"2023-10-14T11:23:56.466866+0000","last_fullsized":"2023-10-14T11:23:56.466866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881246+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:57.881246+0000","last_peered":"2023-10-14T11:23:57.881246+0000","last_clean":"2023-10-14T11:23:57.881246+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:57.881246+0000","last_undegraded":"2023-10-14T11:23:57.881246+0000","last_fullsized":"2023-10-14T11:23:57.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881460+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881460+0000","last_peered":"2023-10-14T11:23:57.881460+0000","last_clean":"2023-10-14T11:23:57.881460+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881460+0000","last_undegraded":"2023-10-14T11:23:57.881460+0000","last_fullsized":"2023-10-14T11:23:57.881460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.846831+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:54.846831+0000","last_peered":"2023-10-14T11:23:54.846831+0000","last_clean":"2023-10-14T11:23:54.846831+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:54.846831+0000","last_undegraded":"2023-10-14T11:23:54.846831+0000","last_fullsized":"2023-10-14T11:23:54.846831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54800000000000004}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.625}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36599999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.72199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.308}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.439},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.77300000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.628},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82299999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:03.787 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T11:24:03.788 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:03.944 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.941+0000 7f3d68cc7700 1 Processor -- start 2023-10-14T11:24:03.945 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.941+0000 7f3d68cc7700 1 -- start start 2023-10-14T11:24:03.953 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d68cc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d6406a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d68cc7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6415de40 con 0x7f3d6406adc0 2023-10-14T11:24:03.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d68cc7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d641616f0 con 0x7f3d6415da60 2023-10-14T11:24:03.954 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d68cc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641624b0 con 0x7f3d640c5be0 2023-10-14T11:24:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d62d9d700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3d6406adc0 0x7f3d64071be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42596/0 (socket says 172.21.15.67:42596) 2023-10-14T11:24:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.942+0000 7f3d62d9d700 1 -- 172.21.15.67:0/2031207960 learned_addr learned my addr 172.21.15.67:0/2031207960 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d61d9b700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d6406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.955 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216313698 0 0) 0x7f3d6415de40 con 0x7f3d6406adc0 2023-10-14T11:24:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d4c0035b0 con 0x7f3d6406adc0 2023-10-14T11:24:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745266399 0 0) 0x7f3d4c0035b0 con 0x7f3d6406adc0 2023-10-14T11:24:03.956 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 msgr2=0x7f3d6406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:03.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d6406a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 >> v1:172.21.15.72:6789/0 conn(0x7f3d6415da60 legacy=0x7f3d640c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d641619d0 con 0x7f3d6406adc0 2023-10-14T11:24:03.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7f3d5c0019f0 con 0x7f3d6406adc0 2023-10-14T11:24:03.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 >> v1:172.21.15.67:6789/0 conn(0x7f3d6406adc0 legacy=0x7f3d64071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d4c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c004d90 0x7f3d4c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641624b0 con 0x7f3d4c003a30 2023-10-14T11:24:03.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c00bac0 con 0x7f3d4c004d90 2023-10-14T11:24:03.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c00bc80 con 0x7f3d640c5be0 2023-10-14T11:24:03.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d4c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d61d9b700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d62d9d700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c004d90 0x7f3d4c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 -- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 msgr2=0x7f3d4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:03.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d640c5be0 0x7f3d4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 -- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c004d90 msgr2=0x7f3d4c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:03.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c004d90 0x7f3d4c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d6259c700 1 -- 172.21.15.67:0/2031207960 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c0035b0 con 0x7f3d4c003a30 2023-10-14T11:24:03.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.943+0000 7f3d62d9d700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d4c004d90 0x7f3d4c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:03.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d6259c700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d4c003e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007fd0 tx=0x7f3d4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6719928f63653c55 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580012f0 con 0x7f3d4c003a30 2023-10-14T11:24:03.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580052f0 con 0x7f3d4c003a30 2023-10-14T11:24:03.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d6159a700 1 -- 172.21.15.67:0/2031207960 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58006860 con 0x7f3d4c003a30 2023-10-14T11:24:03.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 -- 172.21.15.67:0/2031207960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 msgr2=0x7f3d4c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/2031207960 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d4c003e50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3d58007fd0 tx=0x7f3d4c005880 comp rx=0 tx=0).stop 2023-10-14T11:24:03.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d62d9d700 1 -- 172.21.15.67:0/2031207960 reap_dead start 2023-10-14T11:24:03.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 -- 172.21.15.67:0/2031207960 shutdown_connections 2023-10-14T11:24:03.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 -- 172.21.15.67:0/2031207960 >> 172.21.15.67:0/2031207960 conn(0x7f3d640d0440 msgr2=0x7f3d640d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:03.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 -- 172.21.15.67:0/2031207960 shutdown_connections 2023-10-14T11:24:03.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.944+0000 7f3d68cc7700 1 -- 172.21.15.67:0/2031207960 wait complete. 2023-10-14T11:24:03.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.946+0000 7f3d68cc7700 1 Processor -- start 2023-10-14T11:24:03.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.946+0000 7f3d68cc7700 1 -- start start 2023-10-14T11:24:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.946+0000 7f3d68cc7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.946+0000 7f3d68cc7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d6415efc0 0x7f3d640af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d6415f730 0x7f3d6415fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640b0fc0 con 0x7f3d4c003a30 2023-10-14T11:24:03.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6415f450 con 0x7f3d6415f730 2023-10-14T11:24:03.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d640b0970 con 0x7f3d6415efc0 2023-10-14T11:24:03.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43310/0 (socket says 172.21.15.67:43310) 2023-10-14T11:24:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 -- 172.21.15.67:0/1657167851 learned_addr learned my addr 172.21.15.67:0/1657167851 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d61d9b700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d6415efc0 0x7f3d640af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d62d9d700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d6415f730 0x7f3d6415fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 -- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d6415efc0 msgr2=0x7f3d640af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d6415efc0 0x7f3d640af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 -- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d6415f730 msgr2=0x7f3d6415fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:03.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d6415f730 0x7f3d6415fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:03.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 -- 172.21.15.67:0/1657167851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d640b0c50 con 0x7f3d4c003a30 2023-10-14T11:24:03.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d6259c700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d58004000 tx=0x7f3d58001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003880 con 0x7f3d4c003a30 2023-10-14T11:24:03.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d580039e0 con 0x7f3d4c003a30 2023-10-14T11:24:03.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d58003d50 con 0x7f3d4c003a30 2023-10-14T11:24:03.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d640b0fc0 con 0x7f3d4c003a30 2023-10-14T11:24:03.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.947+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d64160100 con 0x7f3d4c003a30 2023-10-14T11:24:03.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.948+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d640b07d0 con 0x7f3d4c003a30 2023-10-14T11:24:03.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.949+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3d5801e450 con 0x7f3d4c003a30 2023-10-14T11:24:03.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.949+0000 7f3d52ffd700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 0x7f3d4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:03.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.949+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3d5808a860 con 0x7f3d4c003a30 2023-10-14T11:24:03.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.949+0000 7f3d61d9b700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 0x7f3d4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:03.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.950+0000 7f3d61d9b700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 0x7f3d4406d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d6415e190 tx=0x7f3d54009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:03.975 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:24:03.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:03.954+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3d640b07d0 con 0x7f3d4c003a30 2023-10-14T11:24:03.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:24:04.154 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.151+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d64161f90 con 0x7f3d4406af00 2023-10-14T11:24:04.163 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.160+0000 7f3d52ffd700 1 -- 172.21.15.67:0/1657167851 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289122 (secure 0 0 0) 0x7f3d54004030 con 0x7f3d4406af00 2023-10-14T11:24:04.166 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:04.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 msgr2=0x7f3d4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 0x7f3d4406d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d6415e190 tx=0x7f3d54009210 comp rx=0 tx=0).stop 2023-10-14T11:24:04.169 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 msgr2=0x7f3d640b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3d58004000 tx=0x7f3d58001120 comp rx=0 tx=0).stop 2023-10-14T11:24:04.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 shutdown_connections 2023-10-14T11:24:04.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d6415f730 0x7f3d6415fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.170 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3d4406af00 0x7f3d4406d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3d4c003a30 0x7f3d640b1450 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 --2- 172.21.15.67:0/1657167851 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3d6415efc0 0x7f3d640af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 >> 172.21.15.67:0/1657167851 conn(0x7f3d640d0440 msgr2=0x7f3d640cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 shutdown_connections 2023-10-14T11:24:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.163+0000 7f3d68cc7700 1 -- 172.21.15.67:0/1657167851 wait complete. 2023-10-14T11:24:04.172 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:04.178 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-14T11:24:02.416867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001773"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605436+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605436+0000","last_peered":"2023-10-14T11:23:57.605436+0000","last_clean":"2023-10-14T11:23:57.605436+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605436+0000","last_undegraded":"2023-10-14T11:23:57.605436+0000","last_fullsized":"2023-10-14T11:23:57.605436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881261+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:57.881261+0000","last_peered":"2023-10-14T11:23:57.881261+0000","last_clean":"2023-10-14T11:23:57.881261+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:57.881261+0000","last_undegraded":"2023-10-14T11:23:57.881261+0000","last_fullsized":"2023-10-14T11:23:57.881261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881305+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:57.881305+0000","last_peered":"2023-10-14T11:23:57.881305+0000","last_clean":"2023-10-14T11:23:57.881305+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:57.881305+0000","last_undegraded":"2023-10-14T11:23:57.881305+0000","last_fullsized":"2023-10-14T11:23:57.881305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881869+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:57.881869+0000","last_peered":"2023-10-14T11:23:57.881869+0000","last_clean":"2023-10-14T11:23:57.881869+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:57.881869+0000","last_undegraded":"2023-10-14T11:23:57.881869+0000","last_fullsized":"2023-10-14T11:23:57.881869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881695+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:57.881695+0000","last_peered":"2023-10-14T11:23:57.881695+0000","last_clean":"2023-10-14T11:23:57.881695+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:57.881695+0000","last_undegraded":"2023-10-14T11:23:57.881695+0000","last_fullsized":"2023-10-14T11:23:57.881695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605355+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605355+0000","last_peered":"2023-10-14T11:23:57.605355+0000","last_clean":"2023-10-14T11:23:57.605355+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605355+0000","last_undegraded":"2023-10-14T11:23:57.605355+0000","last_fullsized":"2023-10-14T11:23:57.605355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605377+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605377+0000","last_peered":"2023-10-14T11:23:57.605377+0000","last_clean":"2023-10-14T11:23:57.605377+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605377+0000","last_undegraded":"2023-10-14T11:23:57.605377+0000","last_fullsized":"2023-10-14T11:23:57.605377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881506+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:57.881506+0000","last_peered":"2023-10-14T11:23:57.881506+0000","last_clean":"2023-10-14T11:23:57.881506+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:57.881506+0000","last_undegraded":"2023-10-14T11:23:57.881506+0000","last_fullsized":"2023-10-14T11:23:57.881506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881854+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881854+0000","last_peered":"2023-10-14T11:23:57.881854+0000","last_clean":"2023-10-14T11:23:57.881854+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881854+0000","last_undegraded":"2023-10-14T11:23:57.881854+0000","last_fullsized":"2023-10-14T11:23:57.881854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881368+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:57.881368+0000","last_peered":"2023-10-14T11:23:57.881368+0000","last_clean":"2023-10-14T11:23:57.881368+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:57.881368+0000","last_undegraded":"2023-10-14T11:23:57.881368+0000","last_fullsized":"2023-10-14T11:23:57.881368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882034+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882034+0000","last_peered":"2023-10-14T11:23:57.882034+0000","last_clean":"2023-10-14T11:23:57.882034+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882034+0000","last_undegraded":"2023-10-14T11:23:57.882034+0000","last_fullsized":"2023-10-14T11:23:57.882034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.961946+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:56.961946+0000","last_peered":"2023-10-14T11:23:56.961946+0000","last_clean":"2023-10-14T11:23:56.961946+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:56.961946+0000","last_undegraded":"2023-10-14T11:23:56.961946+0000","last_fullsized":"2023-10-14T11:23:56.961946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605133+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:57.605133+0000","last_peered":"2023-10-14T11:23:57.605133+0000","last_clean":"2023-10-14T11:23:57.605133+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:57.605133+0000","last_undegraded":"2023-10-14T11:23:57.605133+0000","last_fullsized":"2023-10-14T11:23:57.605133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605458+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:57.605458+0000","last_peered":"2023-10-14T11:23:57.605458+0000","last_clean":"2023-10-14T11:23:57.605458+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:57.605458+0000","last_undegraded":"2023-10-14T11:23:57.605458+0000","last_fullsized":"2023-10-14T11:23:57.605458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882087+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:57.882087+0000","last_peered":"2023-10-14T11:23:57.882087+0000","last_clean":"2023-10-14T11:23:57.882087+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:57.882087+0000","last_undegraded":"2023-10-14T11:23:57.882087+0000","last_fullsized":"2023-10-14T11:23:57.882087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881332+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:57.881332+0000","last_peered":"2023-10-14T11:23:57.881332+0000","last_clean":"2023-10-14T11:23:57.881332+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:57.881332+0000","last_undegraded":"2023-10-14T11:23:57.881332+0000","last_fullsized":"2023-10-14T11:23:57.881332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881085+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:57.881085+0000","last_peered":"2023-10-14T11:23:57.881085+0000","last_clean":"2023-10-14T11:23:57.881085+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:57.881085+0000","last_undegraded":"2023-10-14T11:23:57.881085+0000","last_fullsized":"2023-10-14T11:23:57.881085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962188+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:56.962188+0000","last_peered":"2023-10-14T11:23:56.962188+0000","last_clean":"2023-10-14T11:23:56.962188+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:56.962188+0000","last_undegraded":"2023-10-14T11:23:56.962188+0000","last_fullsized":"2023-10-14T11:23:56.962188+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471268+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:56.471268+0000","last_peered":"2023-10-14T11:23:56.471268+0000","last_clean":"2023-10-14T11:23:56.471268+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:56.471268+0000","last_undegraded":"2023-10-14T11:23:56.471268+0000","last_fullsized":"2023-10-14T11:23:56.471268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881656+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881656+0000","last_peered":"2023-10-14T11:23:57.881656+0000","last_clean":"2023-10-14T11:23:57.881656+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881656+0000","last_undegraded":"2023-10-14T11:23:57.881656+0000","last_fullsized":"2023-10-14T11:23:57.881656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881483+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881483+0000","last_peered":"2023-10-14T11:23:57.881483+0000","last_clean":"2023-10-14T11:23:57.881483+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881483+0000","last_undegraded":"2023-10-14T11:23:57.881483+0000","last_fullsized":"2023-10-14T11:23:57.881483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466998+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:56.466998+0000","last_peered":"2023-10-14T11:23:56.466998+0000","last_clean":"2023-10-14T11:23:56.466998+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:56.466998+0000","last_undegraded":"2023-10-14T11:23:56.466998+0000","last_fullsized":"2023-10-14T11:23:56.466998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605354+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605354+0000","last_peered":"2023-10-14T11:23:57.605354+0000","last_clean":"2023-10-14T11:23:57.605354+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605354+0000","last_undegraded":"2023-10-14T11:23:57.605354+0000","last_fullsized":"2023-10-14T11:23:57.605354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466904+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:56.466904+0000","last_peered":"2023-10-14T11:23:56.466904+0000","last_clean":"2023-10-14T11:23:56.466904+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:56.466904+0000","last_undegraded":"2023-10-14T11:23:56.466904+0000","last_fullsized":"2023-10-14T11:23:56.466904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881917+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:57.881917+0000","last_peered":"2023-10-14T11:23:57.881917+0000","last_clean":"2023-10-14T11:23:57.881917+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:57.881917+0000","last_undegraded":"2023-10-14T11:23:57.881917+0000","last_fullsized":"2023-10-14T11:23:57.881917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466768+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:56.466768+0000","last_peered":"2023-10-14T11:23:56.466768+0000","last_clean":"2023-10-14T11:23:56.466768+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:56.466768+0000","last_undegraded":"2023-10-14T11:23:56.466768+0000","last_fullsized":"2023-10-14T11:23:56.466768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605582+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605582+0000","last_peered":"2023-10-14T11:23:57.605582+0000","last_clean":"2023-10-14T11:23:57.605582+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605582+0000","last_undegraded":"2023-10-14T11:23:57.605582+0000","last_fullsized":"2023-10-14T11:23:57.605582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471278+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:56.471278+0000","last_peered":"2023-10-14T11:23:56.471278+0000","last_clean":"2023-10-14T11:23:56.471278+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:56.471278+0000","last_undegraded":"2023-10-14T11:23:56.471278+0000","last_fullsized":"2023-10-14T11:23:56.471278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466952+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:56.466952+0000","last_peered":"2023-10-14T11:23:56.466952+0000","last_clean":"2023-10-14T11:23:56.466952+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:56.466952+0000","last_undegraded":"2023-10-14T11:23:56.466952+0000","last_fullsized":"2023-10-14T11:23:56.466952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605437+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605437+0000","last_peered":"2023-10-14T11:23:57.605437+0000","last_clean":"2023-10-14T11:23:57.605437+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605437+0000","last_undegraded":"2023-10-14T11:23:57.605437+0000","last_fullsized":"2023-10-14T11:23:57.605437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466951+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:56.466951+0000","last_peered":"2023-10-14T11:23:56.466951+0000","last_clean":"2023-10-14T11:23:56.466951+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:56.466951+0000","last_undegraded":"2023-10-14T11:23:56.466951+0000","last_fullsized":"2023-10-14T11:23:56.466951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881653+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881653+0000","last_peered":"2023-10-14T11:23:57.881653+0000","last_clean":"2023-10-14T11:23:57.881653+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881653+0000","last_undegraded":"2023-10-14T11:23:57.881653+0000","last_fullsized":"2023-10-14T11:23:57.881653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881694+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:57.881694+0000","last_peered":"2023-10-14T11:23:57.881694+0000","last_clean":"2023-10-14T11:23:57.881694+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:57.881694+0000","last_undegraded":"2023-10-14T11:23:57.881694+0000","last_fullsized":"2023-10-14T11:23:57.881694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605690+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605690+0000","last_peered":"2023-10-14T11:23:57.605690+0000","last_clean":"2023-10-14T11:23:57.605690+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605690+0000","last_undegraded":"2023-10-14T11:23:57.605690+0000","last_fullsized":"2023-10-14T11:23:57.605690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467101+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:56.467101+0000","last_peered":"2023-10-14T11:23:56.467101+0000","last_clean":"2023-10-14T11:23:56.467101+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:56.467101+0000","last_undegraded":"2023-10-14T11:23:56.467101+0000","last_fullsized":"2023-10-14T11:23:56.467101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467061+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:56.467061+0000","last_peered":"2023-10-14T11:23:56.467061+0000","last_clean":"2023-10-14T11:23:56.467061+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:56.467061+0000","last_undegraded":"2023-10-14T11:23:56.467061+0000","last_fullsized":"2023-10-14T11:23:56.467061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467037+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:56.467037+0000","last_peered":"2023-10-14T11:23:56.467037+0000","last_clean":"2023-10-14T11:23:56.467037+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:56.467037+0000","last_undegraded":"2023-10-14T11:23:56.467037+0000","last_fullsized":"2023-10-14T11:23:56.467037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471219+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:56.471219+0000","last_peered":"2023-10-14T11:23:56.471219+0000","last_clean":"2023-10-14T11:23:56.471219+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:56.471219+0000","last_undegraded":"2023-10-14T11:23:56.471219+0000","last_fullsized":"2023-10-14T11:23:56.471219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466847+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:56.466847+0000","last_peered":"2023-10-14T11:23:56.466847+0000","last_clean":"2023-10-14T11:23:56.466847+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:56.466847+0000","last_undegraded":"2023-10-14T11:23:56.466847+0000","last_fullsized":"2023-10-14T11:23:56.466847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881382+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881382+0000","last_peered":"2023-10-14T11:23:57.881382+0000","last_clean":"2023-10-14T11:23:57.881382+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881382+0000","last_undegraded":"2023-10-14T11:23:57.881382+0000","last_fullsized":"2023-10-14T11:23:57.881382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466801+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:56.466801+0000","last_peered":"2023-10-14T11:23:56.466801+0000","last_clean":"2023-10-14T11:23:56.466801+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:56.466801+0000","last_undegraded":"2023-10-14T11:23:56.466801+0000","last_fullsized":"2023-10-14T11:23:56.466801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605585+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605585+0000","last_peered":"2023-10-14T11:23:57.605585+0000","last_clean":"2023-10-14T11:23:57.605585+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605585+0000","last_undegraded":"2023-10-14T11:23:57.605585+0000","last_fullsized":"2023-10-14T11:23:57.605585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962355+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:56.962355+0000","last_peered":"2023-10-14T11:23:56.962355+0000","last_clean":"2023-10-14T11:23:56.962355+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:56.962355+0000","last_undegraded":"2023-10-14T11:23:56.962355+0000","last_fullsized":"2023-10-14T11:23:56.962355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962185+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:56.962185+0000","last_peered":"2023-10-14T11:23:56.962185+0000","last_clean":"2023-10-14T11:23:56.962185+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:56.962185+0000","last_undegraded":"2023-10-14T11:23:56.962185+0000","last_fullsized":"2023-10-14T11:23:56.962185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:34.855944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.471206+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:56.471206+0000","last_peered":"2023-10-14T11:23:56.471206+0000","last_clean":"2023-10-14T11:23:56.471206+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:56.471206+0000","last_undegraded":"2023-10-14T11:23:56.471206+0000","last_fullsized":"2023-10-14T11:23:56.471206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962295+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:56.962295+0000","last_peered":"2023-10-14T11:23:56.962295+0000","last_clean":"2023-10-14T11:23:56.962295+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:56.962295+0000","last_undegraded":"2023-10-14T11:23:56.962295+0000","last_fullsized":"2023-10-14T11:23:56.962295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:52.214795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466866+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:56.466866+0000","last_peered":"2023-10-14T11:23:56.466866+0000","last_clean":"2023-10-14T11:23:56.466866+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:56.466866+0000","last_undegraded":"2023-10-14T11:23:56.466866+0000","last_fullsized":"2023-10-14T11:23:56.466866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881246+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:57.881246+0000","last_peered":"2023-10-14T11:23:57.881246+0000","last_clean":"2023-10-14T11:23:57.881246+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:57.881246+0000","last_undegraded":"2023-10-14T11:23:57.881246+0000","last_fullsized":"2023-10-14T11:23:57.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881460+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881460+0000","last_peered":"2023-10-14T11:23:57.881460+0000","last_clean":"2023-10-14T11:23:57.881460+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881460+0000","last_undegraded":"2023-10-14T11:23:57.881460+0000","last_fullsized":"2023-10-14T11:23:57.881460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.846831+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:54.846831+0000","last_peered":"2023-10-14T11:23:54.846831+0000","last_clean":"2023-10-14T11:23:54.846831+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:54.846831+0000","last_undegraded":"2023-10-14T11:23:54.846831+0000","last_fullsized":"2023-10-14T11:23:54.846831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.48599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.54800000000000004}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.625}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.44}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.442}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.36599999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.46300000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.5},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.34599999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.42399999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.27600000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.67900000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.72199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.26000000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.308}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36499999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.64900000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.30599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.38600000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.439},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55500000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.59599999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.63400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.373}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.61499999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.77300000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.628},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.85699999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.746}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.89700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.82299999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.69699999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:04.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T11:24:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.340+0000 7f31acacf700 1 Processor -- start 2023-10-14T11:24:04.343 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.340+0000 7f31acacf700 1 -- start start 2023-10-14T11:24:04.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31acacf700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31a815da60 0x7f31a80c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31acacf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a806a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.346 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31acacf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a80c5e70 con 0x7f31a806adc0 2023-10-14T11:24:04.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31acacf700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a81624b0 con 0x7f31a815da60 2023-10-14T11:24:04.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31acacf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a815de40 con 0x7f31a80c5a10 2023-10-14T11:24:04.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31a815da60 0x7f31a80c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.347 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f31a815da60 0x7f31a80c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43318/0 (socket says 172.21.15.67:43318) 2023-10-14T11:24:04.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 -- 172.21.15.67:0/3657507858 learned_addr learned my addr 172.21.15.67:0/3657507858 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:04.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a5d9b700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.348 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 -- 172.21.15.67:0/3657507858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 msgr2=0x7f31a806a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a806a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 -- 172.21.15.67:0/3657507858 >> v1:172.21.15.72:6789/0 conn(0x7f31a806adc0 legacy=0x7f31a806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.341+0000 7f31a659c700 1 -- 172.21.15.67:0/3657507858 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a81616f0 con 0x7f31a815da60 2023-10-14T11:24:04.349 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31a659c700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a80c54d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31980098f0 tx=0x7f3198009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd9d8d96ef1c6c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:04.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31a559a700 1 -- 172.21.15.67:0/3657507858 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800b8a0 con 0x7f31a815da60 2023-10-14T11:24:04.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31a559a700 1 -- 172.21.15.67:0/3657507858 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800ba00 con 0x7f31a815da60 2023-10-14T11:24:04.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31a559a700 1 -- 172.21.15.67:0/3657507858 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800bd90 con 0x7f31a815da60 2023-10-14T11:24:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 -- 172.21.15.67:0/3657507858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 msgr2=0x7f31a80c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a80c54d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31980098f0 tx=0x7f3198009c00 comp rx=0 tx=0).stop 2023-10-14T11:24:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 -- 172.21.15.67:0/3657507858 shutdown_connections 2023-10-14T11:24:04.351 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a80c54d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 --2- 172.21.15.67:0/3657507858 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a806a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 -- 172.21.15.67:0/3657507858 >> 172.21.15.67:0/3657507858 conn(0x7f31a80d0440 msgr2=0x7f31a80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 -- 172.21.15.67:0/3657507858 shutdown_connections 2023-10-14T11:24:04.352 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.342+0000 7f31acacf700 1 -- 172.21.15.67:0/3657507858 wait complete. 2023-10-14T11:24:04.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 Processor -- start 2023-10-14T11:24:04.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 -- start start 2023-10-14T11:24:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a806adc0 0x7f31a8143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80ca870 con 0x7f31a815da60 2023-10-14T11:24:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80b3570 con 0x7f31a806adc0 2023-10-14T11:24:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.344+0000 7f31acacf700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8143d60 con 0x7f31a80c5a10 2023-10-14T11:24:04.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43328/0 (socket says 172.21.15.67:43328) 2023-10-14T11:24:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 -- 172.21.15.67:0/4120812000 learned_addr learned my addr 172.21.15.67:0/4120812000 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a5d9b700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a659c700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a806adc0 0x7f31a8143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 -- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 msgr2=0x7f31a80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a80c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 -- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a806adc0 msgr2=0x7f31a8143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a806adc0 0x7f31a8143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 -- 172.21.15.67:0/4120812000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198009550 con 0x7f31a815da60 2023-10-14T11:24:04.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31a6d9d700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cb50 tx=0x7f31a000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:04.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003c00 con 0x7f31a815da60 2023-10-14T11:24:04.362 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a0003d60 con 0x7f31a815da60 2023-10-14T11:24:04.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000aa20 con 0x7f31a815da60 2023-10-14T11:24:04.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a80ca2b0 con 0x7f31a815da60 2023-10-14T11:24:04.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.345+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a80b3810 con 0x7f31a815da60 2023-10-14T11:24:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.346+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a80b33d0 con 0x7f31a815da60 2023-10-14T11:24:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.347+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f31a000ab80 con 0x7f31a815da60 2023-10-14T11:24:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.347+0000 7f3196ffd700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 0x7f318806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:04.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.347+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f31a00895d0 con 0x7f31a815da60 2023-10-14T11:24:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.347+0000 7f31a659c700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 0x7f318806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.348+0000 7f31a659c700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 0x7f318806d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3198009c40 tx=0x7f3198008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:04.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.352+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f31a80b33d0 con 0x7f31a815da60 2023-10-14T11:24:04.556 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.553+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31a80b33d0 con 0x7f31a815da60 2023-10-14T11:24:04.557 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.554+0000 7f3196ffd700 1 -- 172.21.15.67:0/4120812000 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f31a80b33d0 con 0x7f31a815da60 2023-10-14T11:24:04.558 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:04.558 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":32,"fsid":"c6e5b03d-6480-4879-8e8f-035e52bef8e2","created":"2023-10-14T11:22:40.706756+0000","modified":"2023-10-14T11:23:55.843760+0000","last_up_change":"2023-10-14T11:22:51.404950+0000","last_in_change":"2023-10-14T11:22:43.177082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T11:22:52.459916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T11:23:52.391308+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_data","create_time":"2023-10-14T11:23:53.222815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9dd6efa-3c88-45de-9a0e-eb15395fce91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6809","nonce":1521584276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6811","nonce":1521584276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6815","nonce":1521584276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":1521584276},{"type":"v1","addr":"172.21.15.67:6813","nonce":1521584276}]},"public_addr":"172.21.15.67:6809/1521584276","cluster_addr":"172.21.15.67:6811/1521584276","heartbeat_back_addr":"172.21.15.67:6815/1521584276","heartbeat_front_addr":"172.21.15.67:6813/1521584276","state":["exists","up"]},{"osd":1,"uuid":"d3f92ea5-a127-4806-b0f5-868bb76022e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6817","nonce":1515378619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6819","nonce":1515378619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6823","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6825","nonce":1515378619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1515378619},{"type":"v1","addr":"172.21.15.67:6821","nonce":1515378619}]},"public_addr":"172.21.15.67:6817/1515378619","cluster_addr":"172.21.15.67:6819/1515378619","heartbeat_back_addr":"172.21.15.67:6825/1515378619","heartbeat_front_addr":"172.21.15.67:6821/1515378619","state":["exists","up"]},{"osd":2,"uuid":"05452499-a0b7-449d-b8e0-3b9482ad621a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6824","nonce":192790195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6827","nonce":192790195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6831","nonce":192790195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":192790195},{"type":"v1","addr":"172.21.15.67:6829","nonce":192790195}]},"public_addr":"172.21.15.67:6824/192790195","cluster_addr":"172.21.15.67:6827/192790195","heartbeat_back_addr":"172.21.15.67:6831/192790195","heartbeat_front_addr":"172.21.15.67:6829/192790195","state":["exists","up"]},{"osd":3,"uuid":"fbe9cb99-fba8-4821-ba7b-b803a6476cd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6801","nonce":1563372793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6803","nonce":1563372793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6807","nonce":1563372793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":1563372793},{"type":"v1","addr":"172.21.15.67:6805","nonce":1563372793}]},"public_addr":"172.21.15.67:6801/1563372793","cluster_addr":"172.21.15.67:6803/1563372793","heartbeat_back_addr":"172.21.15.67:6807/1563372793","heartbeat_front_addr":"172.21.15.67:6805/1563372793","state":["exists","up"]},{"osd":4,"uuid":"116cac62-68b9-4079-a39e-c8145c3b4e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6801","nonce":3701848169}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6803","nonce":3701848169}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6807","nonce":3701848169}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":3701848169},{"type":"v1","addr":"172.21.15.72:6805","nonce":3701848169}]},"public_addr":"172.21.15.72:6801/3701848169","cluster_addr":"172.21.15.72:6803/3701848169","heartbeat_back_addr":"172.21.15.72:6807/3701848169","heartbeat_front_addr":"172.21.15.72:6805/3701848169","state":["exists","up"]},{"osd":5,"uuid":"2a0ab0c6-6bff-4c0b-9765-36bfe3dea488","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6825","nonce":144247410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6827","nonce":144247410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6831","nonce":144247410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":144247410},{"type":"v1","addr":"172.21.15.72:6829","nonce":144247410}]},"public_addr":"172.21.15.72:6825/144247410","cluster_addr":"172.21.15.72:6827/144247410","heartbeat_back_addr":"172.21.15.72:6831/144247410","heartbeat_front_addr":"172.21.15.72:6829/144247410","state":["exists","up"]},{"osd":6,"uuid":"110976da-bc4a-4dc3-be26-ef2c8a9ceb70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6814","nonce":1411932619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6817","nonce":1411932619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6823","nonce":1411932619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1411932619},{"type":"v1","addr":"172.21.15.72:6820","nonce":1411932619}]},"public_addr":"172.21.15.72:6814/1411932619","cluster_addr":"172.21.15.72:6817/1411932619","heartbeat_back_addr":"172.21.15.72:6823/1411932619","heartbeat_front_addr":"172.21.15.72:6820/1411932619","state":["exists","up"]},{"osd":7,"uuid":"0f6ebd80-a866-4045-864f-0817c6f05d84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6809","nonce":4108692876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6811","nonce":4108692876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6821","nonce":4108692876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6813","nonce":4108692876},{"type":"v1","addr":"172.21.15.72:6816","nonce":4108692876}]},"public_addr":"172.21.15.72:6809/4108692876","cluster_addr":"172.21.15.72:6811/4108692876","heartbeat_back_addr":"172.21.15.72:6821/4108692876","heartbeat_front_addr":"172.21.15.72:6816/4108692876","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417630+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.401769+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.379090+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.404540+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.146947+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.417928+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.099743+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T11:22:48.390792+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T11:24:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 msgr2=0x7f318806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.560 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 0x7f318806d3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3198009c40 tx=0x7f3198008030 comp rx=0 tx=0).stop 2023-10-14T11:24:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 msgr2=0x7f31a815f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cb50 tx=0x7f31a000ce60 comp rx=0 tx=0).stop 2023-10-14T11:24:04.561 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 shutdown_connections 2023-10-14T11:24:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f318806af00 0x7f318806d3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f31a815da60 0x7f31a815f060 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.562 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31a806adc0 0x7f31a8143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 --2- 172.21.15.67:0/4120812000 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f31a80c5a10 0x7f31a80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.556+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 >> 172.21.15.67:0/4120812000 conn(0x7f31a80d0440 msgr2=0x7f31a8158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:04.563 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.557+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 shutdown_connections 2023-10-14T11:24:04.565 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:04.557+0000 7f31acacf700 1 -- 172.21.15.67:0/4120812000 wait complete. 2023-10-14T11:24:05.573 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T11:24:05.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 Processor -- start 2023-10-14T11:24:05.718 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 -- start start 2023-10-14T11:24:05.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f440cd8a0 0x7f5f440cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 0x7f5f4415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f4415b190 0x7f5f4415e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.721 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4415b700 con 0x7f5f440cd8a0 2023-10-14T11:24:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440c2260 con 0x7f5f440c26f0 2023-10-14T11:24:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.715+0000 7f5f4a955700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f440ce1c0 con 0x7f5f4415b190 2023-10-14T11:24:05.722 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f440cd8a0 0x7f5f440cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f5f440cd8a0 0x7f5f440cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43332/0 (socket says 172.21.15.67:43332) 2023-10-14T11:24:05.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 -- 172.21.15.67:0/1772585374 learned_addr learned my addr 172.21.15.67:0/1772585374 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:05.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f48ef2700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f4415b190 0x7f5f4415e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f437fe700 1 --2- 172.21.15.67:0/1772585374 >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 0x7f5f4415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 -- 172.21.15.67:0/1772585374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f4415b190 msgr2=0x7f5f4415e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f4415b190 0x7f5f4415e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 -- 172.21.15.67:0/1772585374 >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 msgr2=0x7f5f4415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 --2- 172.21.15.67:0/1772585374 >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 0x7f5f4415dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 -- 172.21.15.67:0/1772585374 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440c1930 con 0x7f5f440cd8a0 2023-10-14T11:24:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f437fe700 1 --2- 172.21.15.67:0/1772585374 >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 0x7f5f4415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:05.725 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f43fff700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f440cdc80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5f44068e80 tx=0x7f5f34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f393e9bf196a0d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f42ffd700 1 -- 172.21.15.67:0/1772585374 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011830 con 0x7f5f440cd8a0 2023-10-14T11:24:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f42ffd700 1 -- 172.21.15.67:0/1772585374 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34011990 con 0x7f5f440cd8a0 2023-10-14T11:24:05.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.716+0000 7f5f42ffd700 1 -- 172.21.15.67:0/1772585374 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34011d20 con 0x7f5f440cd8a0 2023-10-14T11:24:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 -- 172.21.15.67:0/1772585374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 msgr2=0x7f5f440cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f440cdc80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5f44068e80 tx=0x7f5f34009bd0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 -- 172.21.15.67:0/1772585374 shutdown_connections 2023-10-14T11:24:05.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f4415b190 0x7f5f4415e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 --2- 172.21.15.67:0/1772585374 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f440cdc80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 --2- 172.21.15.67:0/1772585374 >> v2:172.21.15.72:3300/0 conn(0x7f5f440c26f0 0x7f5f4415dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 -- 172.21.15.67:0/1772585374 >> 172.21.15.67:0/1772585374 conn(0x7f5f440b17c0 msgr2=0x7f5f440b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:05.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 -- 172.21.15.67:0/1772585374 shutdown_connections 2023-10-14T11:24:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.717+0000 7f5f4a955700 1 -- 172.21.15.67:0/1772585374 wait complete. 2023-10-14T11:24:05.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.718+0000 7f5f4a955700 1 Processor -- start 2023-10-14T11:24:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.718+0000 7f5f4a955700 1 -- start start 2023-10-14T11:24:05.732 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f440c26f0 0x7f5f441f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f441e3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f4415b190 0x7f5f440b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441594c0 con 0x7f5f440cd8a0 2023-10-14T11:24:05.733 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441e2590 con 0x7f5f4415b190 2023-10-14T11:24:05.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f4a955700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441e2870 con 0x7f5f440c26f0 2023-10-14T11:24:05.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f437fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f441e3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.734 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f437fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f441e3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43340/0 (socket says 172.21.15.67:43340) 2023-10-14T11:24:05.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f437fe700 1 -- 172.21.15.67:0/537793340 learned_addr learned my addr 172.21.15.67:0/537793340 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:05.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f43fff700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f440c26f0 0x7f5f441f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.719+0000 7f5f48ef2700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f4415b190 0x7f5f440b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.735 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 -- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f440c26f0 msgr2=0x7f5f441f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f5f440c26f0 0x7f5f441f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 -- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f4415b190 msgr2=0x7f5f440b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5f4415b190 0x7f5f440b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.736 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f34009550 con 0x7f5f440cd8a0 2023-10-14T11:24:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f437fe700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f441e3fc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00d800 tx=0x7f5f2c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004030 con 0x7f5f440cd8a0 2023-10-14T11:24:05.737 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c004190 con 0x7f5f440cd8a0 2023-10-14T11:24:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441e2b50 con 0x7f5f440cd8a0 2023-10-14T11:24:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004500 con 0x7f5f440cd8a0 2023-10-14T11:24:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.720+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f441f3570 con 0x7f5f440cd8a0 2023-10-14T11:24:05.738 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.721+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f440c1ef0 con 0x7f5f440cd8a0 2023-10-14T11:24:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.721+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5f2c0036a0 con 0x7f5f440cd8a0 2023-10-14T11:24:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f40ff9700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5f2406af00 0x7f5f2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5f2c088df0 con 0x7f5f440cd8a0 2023-10-14T11:24:05.739 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f40ff9700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7f5f24073100 0x7f5f24075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f24075c10 con 0x7f5f24073100 2023-10-14T11:24:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f2c08b450 con 0x7f5f440cd8a0 2023-10-14T11:24:05.740 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f43fff700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5f2406af00 0x7f5f2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f48ef2700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7f5f24073100 0x7f5f24075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f48ef2700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7f5f24073100 0x7f5f24075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.722+0000 7f5f43fff700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5f2406af00 0x7f5f2406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.741 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.723+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== osd.0 v2:172.21.15.67:6808/1521584276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5f24075c10 con 0x7f5f24073100 2023-10-14T11:24:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.738+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 --> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f440c1c10 con 0x7f5f24073100 2023-10-14T11:24:05.742 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.738+0000 7f5f40ff9700 1 -- 172.21.15.67:0/537793340 <== osd.0 v2:172.21.15.67:6808/1521584276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5f3c00b2f0 con 0x7f5f24073100 2023-10-14T11:24:05.743 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:05.743 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:05.743 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.738+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7f5f24073100 msgr2=0x7f5f24075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:6808/1521584276,v1:172.21.15.67:6809/1521584276] conn(0x7f5f24073100 0x7f5f24075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.745 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5f2406af00 msgr2=0x7f5f2406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f5f2406af00 0x7f5f2406d3c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009840 tx=0x7f5f34008030 comp rx=0 tx=0).stop 2023-10-14T11:24:05.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 msgr2=0x7f5f441e3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.746 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 --2- 172.21.15.67:0/537793340 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f5f440cd8a0 0x7f5f441e3fc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00d800 tx=0x7f5f2c00db10 comp rx=0 tx=0).stop 2023-10-14T11:24:05.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f48ef2700 1 -- 172.21.15.67:0/537793340 reap_dead start 2023-10-14T11:24:05.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 shutdown_connections 2023-10-14T11:24:05.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 >> 172.21.15.67:0/537793340 conn(0x7f5f440b17c0 msgr2=0x7f5f440b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:05.747 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 shutdown_connections 2023-10-14T11:24:05.748 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.739+0000 7f5f4a955700 1 -- 172.21.15.67:0/537793340 wait complete. 2023-10-14T11:24:05.754 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T11:24:05.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.877+0000 7fe3d84d8700 1 Processor -- start 2023-10-14T11:24:05.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.877+0000 7fe3d84d8700 1 -- start start 2023-10-14T11:24:05.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d84d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d00cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d84d8700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00cef10 con 0x7fe3d00ceb30 2023-10-14T11:24:05.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d84d8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00d2090 con 0x7fe3d00cffe0 2023-10-14T11:24:05.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d84d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00b0920 con 0x7fe3d00b04c0 2023-10-14T11:24:05.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d6274700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fe3d00ceb30 0x7fe3d00cdc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42642/0 (socket says 172.21.15.67:42642) 2023-10-14T11:24:05.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d6274700 1 -- 172.21.15.67:0/4104158723 learned_addr learned my addr 172.21.15.67:0/4104158723 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:05.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5a73700 1 --2- 172.21.15.67:0/4104158723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d00cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796980646 0 0) 0x7fe3d00cef10 con 0x7fe3d00ceb30 2023-10-14T11:24:05.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3bc0035b0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3300938492 0 0) 0x7fe3bc0035b0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.958 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5a73700 1 -- 172.21.15.67:0/4104158723 >> v1:172.21.15.72:6789/0 conn(0x7fe3d00cffe0 legacy=0x7fe3d015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5a73700 1 -- 172.21.15.67:0/4104158723 >> v1:172.21.15.67:6789/0 conn(0x7fe3d00ceb30 legacy=0x7fe3d00cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5a73700 1 -- 172.21.15.67:0/4104158723 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d015deb0 con 0x7fe3d00b04c0 2023-10-14T11:24:05.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.878+0000 7fe3d5a73700 1 --2- 172.21.15.67:0/4104158723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d00cfaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009870 tx=0x7fe3c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9460114a0ca04121 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.959 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 <== mon.2 v2:172.21.15.72:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc001670 con 0x7fe3d00b04c0 2023-10-14T11:24:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 <== mon.2 v2:172.21.15.72:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0004030 con 0x7fe3d00b04c0 2023-10-14T11:24:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d5272700 1 -- 172.21.15.67:0/4104158723 <== mon.2 v2:172.21.15.72:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c00043c0 con 0x7fe3d00b04c0 2023-10-14T11:24:05.960 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 -- 172.21.15.67:0/4104158723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 msgr2=0x7fe3d00cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/4104158723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d00cfaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009870 tx=0x7fe3c0009b80 comp rx=0 tx=0).stop 2023-10-14T11:24:05.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 -- 172.21.15.67:0/4104158723 shutdown_connections 2023-10-14T11:24:05.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/4104158723 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d00cfaa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 -- 172.21.15.67:0/4104158723 >> 172.21.15.67:0/4104158723 conn(0x7fe3d00d1570 msgr2=0x7fe3d00d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:05.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 -- 172.21.15.67:0/4104158723 shutdown_connections 2023-10-14T11:24:05.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.879+0000 7fe3d84d8700 1 -- 172.21.15.67:0/4104158723 wait complete. 2023-10-14T11:24:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.880+0000 7fe3d84d8700 1 Processor -- start 2023-10-14T11:24:05.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 -- start start 2023-10-14T11:24:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d014aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 0x7fe3d01f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d015bad0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00b5b10 con 0x7fe3d00cffe0 2023-10-14T11:24:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d84d8700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0158a10 con 0x7fe3d00b04c0 2023-10-14T11:24:05.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d5a73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d5a73700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43356/0 (socket says 172.21.15.67:43356) 2023-10-14T11:24:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.881+0000 7fe3d5a73700 1 -- 172.21.15.67:0/2072654938 learned_addr learned my addr 172.21.15.67:0/2072654938 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:05.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d6274700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d014aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d6a75700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 0x7fe3d01f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 -- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 msgr2=0x7fe3d014aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d014aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 -- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 msgr2=0x7fe3d01f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:05.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 0x7fe3d01f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:05.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 -- 172.21.15.67:0/2072654938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c00094a0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d6274700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d014aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d6a75700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 0x7fe3d01f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d5a73700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0000c00 tx=0x7fe3c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0003db0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c001f070 con 0x7fe3d00ceb30 2023-10-14T11:24:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d00b5d60 con 0x7fe3d00ceb30 2023-10-14T11:24:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0011870 con 0x7fe3d00ceb30 2023-10-14T11:24:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.882+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00b6320 con 0x7fe3d00ceb30 2023-10-14T11:24:05.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.883+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d004ebb0 con 0x7fe3d00ceb30 2023-10-14T11:24:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.884+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe3c0021030 con 0x7fe3d00ceb30 2023-10-14T11:24:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.884+0000 7fe3c6ffd700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 0x7fe3b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:05.973 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.884+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe3c008a940 con 0x7fe3d00ceb30 2023-10-14T11:24:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.884+0000 7fe3d6274700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 0x7fe3b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.885+0000 7fe3d6274700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 0x7fe3b406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000f60 tx=0x7fe3cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:05.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:05.889+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3c0055b80 con 0x7fe3d00ceb30 2023-10-14T11:24:06.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.087+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d015e130 con 0x7fe3b406af00 2023-10-14T11:24:06.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.088+0000 7fe3c6ffd700 1 -- 172.21.15.67:0/2072654938 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe3cc007df0 con 0x7fe3b406af00 2023-10-14T11:24:06.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 msgr2=0x7fe3b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 0x7fe3b406d3c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000f60 tx=0x7fe3cc009040 comp rx=0 tx=0).stop 2023-10-14T11:24:06.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 msgr2=0x7fe3d015b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0000c00 tx=0x7fe3c0004750 comp rx=0 tx=0).stop 2023-10-14T11:24:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 shutdown_connections 2023-10-14T11:24:06.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe3d00cffe0 0x7fe3d01f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fe3d00b04c0 0x7fe3d014aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fe3b406af00 0x7fe3b406d3c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 --2- 172.21.15.67:0/2072654938 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fe3d00ceb30 0x7fe3d015b590 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.095 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 >> 172.21.15.67:0/2072654938 conn(0x7fe3d00d1570 msgr2=0x7fe3d00aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 shutdown_connections 2023-10-14T11:24:06.096 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.090+0000 7fe3d84d8700 1 -- 172.21.15.67:0/2072654938 wait complete. 2023-10-14T11:24:06.097 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T11:24:06.105 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T11:24:06.105 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:06.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.231+0000 7f148fbe7700 1 Processor -- start 2023-10-14T11:24:06.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.231+0000 7f148fbe7700 1 -- start start 2023-10-14T11:24:06.237 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148fbe7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f148815d8d0 0x7f1488161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148fbe7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f148806af20 0x7f14880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148fbe7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1488162440 con 0x7f1488071b70 2023-10-14T11:24:06.238 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148fbe7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488070320 con 0x7f148806af20 2023-10-14T11:24:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148fbe7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488072000 con 0x7f148815d8d0 2023-10-14T11:24:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f148806af20 0x7f14880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.239 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148d182700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f1488071b70 0x7f148806a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42656/0 (socket says 172.21.15.67:42656) 2023-10-14T11:24:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f148806af20 0x7f14880b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43364/0 (socket says 172.21.15.67:43364) 2023-10-14T11:24:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148d182700 1 -- 172.21.15.67:0/2206991255 learned_addr learned my addr 172.21.15.67:0/2206991255 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:06.240 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148d983700 1 --2- 172.21.15.67:0/2206991255 >> v2:172.21.15.72:3300/0 conn(0x7f148815d8d0 0x7f1488161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 -- 172.21.15.67:0/2206991255 >> v2:172.21.15.72:3300/0 conn(0x7f148815d8d0 msgr2=0x7f1488161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:06.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 --2- 172.21.15.67:0/2206991255 >> v2:172.21.15.72:3300/0 conn(0x7f148815d8d0 0x7f1488161f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 -- 172.21.15.67:0/2206991255 >> v1:172.21.15.67:6789/0 conn(0x7f1488071b70 legacy=0x7f148806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 -- 172.21.15.67:0/2206991255 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880722e0 con 0x7f148806af20 2023-10-14T11:24:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148c981700 1 -- 172.21.15.67:0/2206991255 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181563785 0 0) 0x7f1478001110 con 0x7f1488071b70 2023-10-14T11:24:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.232+0000 7f148e184700 1 --2- 172.21.15.67:0/2206991255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148806af20 0x7f14880b32e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f14880b30a0 tx=0x7f148000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ba17edea0c807f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148c981700 1 -- 172.21.15.67:0/2206991255 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000e070 con 0x7f148806af20 2023-10-14T11:24:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148c981700 1 -- 172.21.15.67:0/2206991255 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148000bb20 con 0x7f148806af20 2023-10-14T11:24:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148c981700 1 -- 172.21.15.67:0/2206991255 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480012430 con 0x7f148806af20 2023-10-14T11:24:06.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 -- 172.21.15.67:0/2206991255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148806af20 msgr2=0x7f14880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 --2- 172.21.15.67:0/2206991255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148806af20 0x7f14880b32e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f14880b30a0 tx=0x7f148000b330 comp rx=0 tx=0).stop 2023-10-14T11:24:06.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 -- 172.21.15.67:0/2206991255 shutdown_connections 2023-10-14T11:24:06.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 --2- 172.21.15.67:0/2206991255 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148806af20 0x7f14880b32e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 --2- 172.21.15.67:0/2206991255 >> v2:172.21.15.72:3300/0 conn(0x7f148815d8d0 0x7f1488161f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 -- 172.21.15.67:0/2206991255 >> 172.21.15.67:0/2206991255 conn(0x7f148806db70 msgr2=0x7f148806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 -- 172.21.15.67:0/2206991255 shutdown_connections 2023-10-14T11:24:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.233+0000 7f148fbe7700 1 -- 172.21.15.67:0/2206991255 wait complete. 2023-10-14T11:24:06.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.234+0000 7f148fbe7700 1 Processor -- start 2023-10-14T11:24:06.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 -- start start 2023-10-14T11:24:06.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f148806af20 0x7f14881f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 0x7f14880c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14880c6df0 0x7f14881f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880af1a0 con 0x7f148815d8d0 2023-10-14T11:24:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880ae620 con 0x7f14880c6df0 2023-10-14T11:24:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148fbe7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14880ae900 con 0x7f148806af20 2023-10-14T11:24:06.250 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148d182700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 0x7f14880c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148d182700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 0x7f14880c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43368/0 (socket says 172.21.15.67:43368) 2023-10-14T11:24:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.235+0000 7f148d182700 1 -- 172.21.15.67:0/57248654 learned_addr learned my addr 172.21.15.67:0/57248654 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:06.251 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d983700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f148806af20 0x7f14881f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 -- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f148806af20 msgr2=0x7f14881f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148e184700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14880c6df0 0x7f14881f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f148806af20 0x7f14881f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.252 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 -- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14880c6df0 msgr2=0x7f14881f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14880c6df0 0x7f14881f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480009a70 con 0x7f148815d8d0 2023-10-14T11:24:06.253 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d983700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f148806af20 0x7f14881f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148d182700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 0x7f14880c68b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f147800c550 tx=0x7f147800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478004c80 con 0x7f148815d8d0 2023-10-14T11:24:06.254 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478004e00 con 0x7f148815d8d0 2023-10-14T11:24:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478007310 con 0x7f148815d8d0 2023-10-14T11:24:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14880aebe0 con 0x7f148815d8d0 2023-10-14T11:24:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.236+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14881f2d80 con 0x7f148815d8d0 2023-10-14T11:24:06.255 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.237+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14880728a0 con 0x7f148815d8d0 2023-10-14T11:24:06.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.237+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1478007470 con 0x7f148815d8d0 2023-10-14T11:24:06.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f147e7fc700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f146c06af00 0x7f146c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.256 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f1478089160 con 0x7f148815d8d0 2023-10-14T11:24:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f147e7fc700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f146c073100 0x7f146c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f146c075c10 con 0x7f146c073100 2023-10-14T11:24:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f148d983700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f146c06af00 0x7f146c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.257 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f147808b820 con 0x7f148815d8d0 2023-10-14T11:24:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f148e184700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f146c073100 0x7f146c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f148e184700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f146c073100 0x7f146c075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.258 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.238+0000 7f148d983700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f146c06af00 0x7f146c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1488160dd0 tx=0x7f1484008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.239+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== osd.1 v2:172.21.15.67:6816/1515378619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f146c075c10 con 0x7f146c073100 2023-10-14T11:24:06.259 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.254+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 --> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f14880725c0 con 0x7f146c073100 2023-10-14T11:24:06.260 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.254+0000 7f147e7fc700 1 -- 172.21.15.67:0/57248654 <== osd.1 v2:172.21.15.67:6816/1515378619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1480003b20 con 0x7f146c073100 2023-10-14T11:24:06.260 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:06.260 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:06.261 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.254+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f146c073100 msgr2=0x7f146c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.254+0000 7f148fbe7700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:6816/1515378619,v1:172.21.15.67:6817/1515378619] conn(0x7f146c073100 0x7f146c075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.262 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f146c06af00 msgr2=0x7f146c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f146c06af00 0x7f146c06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1488160dd0 tx=0x7f1484008040 comp rx=0 tx=0).stop 2023-10-14T11:24:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 msgr2=0x7f14880c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.263 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 --2- 172.21.15.67:0/57248654 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f148815d8d0 0x7f14880c68b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f147800c550 tx=0x7f147800c910 comp rx=0 tx=0).stop 2023-10-14T11:24:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148e184700 1 -- 172.21.15.67:0/57248654 reap_dead start 2023-10-14T11:24:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 shutdown_connections 2023-10-14T11:24:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 >> 172.21.15.67:0/57248654 conn(0x7f148806db70 msgr2=0x7f14880b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.264 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 shutdown_connections 2023-10-14T11:24:06.265 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.255+0000 7f148fbe7700 1 -- 172.21.15.67:0/57248654 wait complete. 2023-10-14T11:24:06.269 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T11:24:06.394 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.392+0000 7fa7fcac9700 1 Processor -- start 2023-10-14T11:24:06.395 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.392+0000 7fa7fcac9700 1 -- start start 2023-10-14T11:24:06.397 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7fcac9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8161ee0 0x7fa7f80d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7fcac9700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7f8162340 0x7fa7f80d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7fcac9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f80ce360 con 0x7fa7f81610f0 2023-10-14T11:24:06.398 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7fcac9700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7f80d00c0 con 0x7fa7f8162340 2023-10-14T11:24:06.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7fcac9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f80d03a0 con 0x7fa7f8161ee0 2023-10-14T11:24:06.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7f8162340 0x7fa7f80d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa7f8162340 0x7fa7f80d1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43380/0 (socket says 172.21.15.67:43380) 2023-10-14T11:24:06.399 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 -- 172.21.15.67:0/2437239353 learned_addr learned my addr 172.21.15.67:0/2437239353 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:06.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f5d9b700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8161ee0 0x7fa7f80d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 -- 172.21.15.67:0/2437239353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8161ee0 msgr2=0x7fa7f80d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:06.400 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8161ee0 0x7fa7f80d1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 -- 172.21.15.67:0/2437239353 >> v1:172.21.15.72:6789/0 conn(0x7fa7f81610f0 legacy=0x7fa7f81617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 -- 172.21.15.67:0/2437239353 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f80d0680 con 0x7fa7f8162340 2023-10-14T11:24:06.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f559a700 1 -- 172.21.15.67:0/2437239353 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069995470 0 0) 0x7fa7f80ce360 con 0x7fa7f81610f0 2023-10-14T11:24:06.401 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f6d9d700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f8162340 0x7fa7f80d1860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009e50 tx=0x7fa7f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8919a991c47da0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f559a700 1 -- 172.21.15.67:0/2437239353 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000e070 con 0x7fa7f8162340 2023-10-14T11:24:06.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f559a700 1 -- 172.21.15.67:0/2437239353 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f000b910 con 0x7fa7f8162340 2023-10-14T11:24:06.402 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.393+0000 7fa7f559a700 1 -- 172.21.15.67:0/2437239353 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000bcc0 con 0x7fa7f8162340 2023-10-14T11:24:06.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2437239353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f8162340 msgr2=0x7fa7f80d1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f8162340 0x7fa7f80d1860 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009e50 tx=0x7fa7f000b330 comp rx=0 tx=0).stop 2023-10-14T11:24:06.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2437239353 shutdown_connections 2023-10-14T11:24:06.403 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f8162340 0x7fa7f80d1860 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.404 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2437239353 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8161ee0 0x7fa7f80d1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.404 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2437239353 >> 172.21.15.67:0/2437239353 conn(0x7fa7f809cab0 msgr2=0x7fa7f80d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.404 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2437239353 shutdown_connections 2023-10-14T11:24:06.405 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.394+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2437239353 wait complete. 2023-10-14T11:24:06.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 Processor -- start 2023-10-14T11:24:06.407 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 -- start start 2023-10-14T11:24:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f8161ee0 0x7fa7f80cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.408 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8162340 0x7fa7f815f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81f40c0 con 0x7fa7f81610f0 2023-10-14T11:24:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81f3ea0 con 0x7fa7f8161ee0 2023-10-14T11:24:06.409 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7fcac9700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f81f3290 con 0x7fa7f8162340 2023-10-14T11:24:06.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7f659c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43382/0 (socket says 172.21.15.67:43382) 2023-10-14T11:24:06.410 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.396+0000 7fa7f659c700 1 -- 172.21.15.67:0/2793322325 learned_addr learned my addr 172.21.15.67:0/2793322325 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:06.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f5d9b700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f8161ee0 0x7fa7f80cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.411 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f6d9d700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8162340 0x7fa7f815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 -- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8162340 msgr2=0x7fa7f815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.412 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8162340 0x7fa7f815f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 -- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f8161ee0 msgr2=0x7fa7f80cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f8161ee0 0x7fa7f80cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.413 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 -- 172.21.15.67:0/2793322325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009b30 con 0x7fa7f81610f0 2023-10-14T11:24:06.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7f659c700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c4a0 tx=0x7fa7e800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80054e0 con 0x7fa7f81610f0 2023-10-14T11:24:06.414 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e80036d0 con 0x7fa7f81610f0 2023-10-14T11:24:06.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f81f3570 con 0x7fa7f81610f0 2023-10-14T11:24:06.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8003a80 con 0x7fa7f81610f0 2023-10-14T11:24:06.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.397+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f81f3b30 con 0x7fa7f81610f0 2023-10-14T11:24:06.415 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.398+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f804ebb0 con 0x7fa7f81610f0 2023-10-14T11:24:06.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.398+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa7e8003be0 con 0x7fa7f81610f0 2023-10-14T11:24:06.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.399+0000 7fa7e6ffd700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 0x7fa7d806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.416 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.399+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa7e8088b30 con 0x7fa7f81610f0 2023-10-14T11:24:06.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.399+0000 7fa7f5d9b700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 0x7fa7d806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.399+0000 7fa7f5d9b700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 0x7fa7d806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009b70 tx=0x7fa7ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.417 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.403+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa7e8053bc0 con 0x7fa7f81610f0 2023-10-14T11:24:06.609 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.606+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7f81614d0 con 0x7fa7d806af00 2023-10-14T11:24:06.610 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.607+0000 7fa7e6ffd700 1 -- 172.21.15.67:0/2793322325 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa7ec0117b0 con 0x7fa7d806af00 2023-10-14T11:24:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 msgr2=0x7fa7d806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 0x7fa7d806d3c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009b70 tx=0x7fa7ec008040 comp rx=0 tx=0).stop 2023-10-14T11:24:06.613 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 msgr2=0x7fa7f8152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c4a0 tx=0x7fa7e800c860 comp rx=0 tx=0).stop 2023-10-14T11:24:06.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 shutdown_connections 2023-10-14T11:24:06.614 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa7f8162340 0x7fa7f815f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa7d806af00 0x7fa7d806d3c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa7f81610f0 0x7fa7f8152fd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 --2- 172.21.15.67:0/2793322325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f8161ee0 0x7fa7f80cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.615 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.609+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 >> 172.21.15.67:0/2793322325 conn(0x7fa7f809cab0 msgr2=0x7fa7f80b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.610+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 shutdown_connections 2023-10-14T11:24:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.610+0000 7fa7fcac9700 1 -- 172.21.15.67:0/2793322325 wait complete. 2023-10-14T11:24:06.616 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T11:24:06.625 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T11:24:06.625 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.751+0000 7f7b566e7700 1 Processor -- start 2023-10-14T11:24:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.751+0000 7f7b566e7700 1 -- start start 2023-10-14T11:24:06.757 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b566e7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b5006af20 0x7f7b50161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b566e7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b50162440 con 0x7f7b50071b70 2023-10-14T11:24:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b566e7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b50070320 con 0x7f7b5015d8d0 2023-10-14T11:24:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b566e7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b50072000 con 0x7f7b5006af20 2023-10-14T11:24:06.758 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b4f7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f7b50071b70 0x7f7b500b32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42684/0 (socket says 172.21.15.67:42684) 2023-10-14T11:24:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b4f7fe700 1 -- 172.21.15.67:0/333241956 learned_addr learned my addr 172.21.15.67:0/333241956 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.752+0000 7f7b54c84700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f7b5006af20 0x7f7b50161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b4effd700 1 -- 172.21.15.67:0/333241956 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568948486 0 0) 0x7f7b38001110 con 0x7f7b50071b70 2023-10-14T11:24:06.759 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b4effd700 1 -- 172.21.15.67:0/333241956 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b3c0035b0 con 0x7f7b50071b70 2023-10-14T11:24:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b54c84700 1 -- 172.21.15.67:0/333241956 >> v1:172.21.15.72:6789/0 conn(0x7f7b5015d8d0 legacy=0x7f7b5006a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b54c84700 1 -- 172.21.15.67:0/333241956 >> v1:172.21.15.67:6789/0 conn(0x7f7b50071b70 legacy=0x7f7b500b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b54c84700 1 -- 172.21.15.67:0/333241956 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500722e0 con 0x7f7b5006af20 2023-10-14T11:24:06.760 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b54c84700 1 --2- 172.21.15.67:0/333241956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b50161f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009d90 tx=0x7f7b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e800bf797242119 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b4effd700 1 -- 172.21.15.67:0/333241956 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800e070 con 0x7f7b5006af20 2023-10-14T11:24:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b4effd700 1 -- 172.21.15.67:0/333241956 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800bae0 con 0x7f7b5006af20 2023-10-14T11:24:06.761 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b4effd700 1 -- 172.21.15.67:0/333241956 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800be90 con 0x7f7b5006af20 2023-10-14T11:24:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b566e7700 1 -- 172.21.15.67:0/333241956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 msgr2=0x7f7b50161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.753+0000 7f7b566e7700 1 --2- 172.21.15.67:0/333241956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b50161f00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009d90 tx=0x7f7b4800b330 comp rx=0 tx=0).stop 2023-10-14T11:24:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.754+0000 7f7b566e7700 1 -- 172.21.15.67:0/333241956 shutdown_connections 2023-10-14T11:24:06.762 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.754+0000 7f7b566e7700 1 --2- 172.21.15.67:0/333241956 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b50161f00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.754+0000 7f7b566e7700 1 -- 172.21.15.67:0/333241956 >> 172.21.15.67:0/333241956 conn(0x7f7b5006db70 msgr2=0x7f7b5006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.754+0000 7f7b566e7700 1 -- 172.21.15.67:0/333241956 shutdown_connections 2023-10-14T11:24:06.763 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.754+0000 7f7b566e7700 1 -- 172.21.15.67:0/333241956 wait complete. 2023-10-14T11:24:06.766 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.755+0000 7f7b566e7700 1 Processor -- start 2023-10-14T11:24:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.755+0000 7f7b566e7700 1 -- start start 2023-10-14T11:24:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b500c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.767 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b5015d8d0 0x7f7b501f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b500c4930 0x7f7b500ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500c5a50 con 0x7f7b5006af20 2023-10-14T11:24:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b501582e0 con 0x7f7b5015d8d0 2023-10-14T11:24:06.768 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b500cb1a0 con 0x7f7b500c4930 2023-10-14T11:24:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b500c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b500c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43394/0 (socket says 172.21.15.67:43394) 2023-10-14T11:24:06.769 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 -- 172.21.15.67:0/1571604098 learned_addr learned my addr 172.21.15.67:0/1571604098 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4f7fe700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b5015d8d0 0x7f7b501f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b54c84700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b500c4930 0x7f7b500ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 -- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b500c4930 msgr2=0x7f7b500ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.770 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f7b500c4930 0x7f7b500ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 -- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b5015d8d0 msgr2=0x7f7b501f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b5015d8d0 0x7f7b501f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.771 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48009a70 con 0x7f7b5006af20 2023-10-14T11:24:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4f7fe700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7b5015d8d0 0x7f7b501f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4ffff700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b500c60f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000b4d0 tx=0x7f7b4000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40011830 con 0x7f7b5006af20 2023-10-14T11:24:06.772 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b40011990 con 0x7f7b5006af20 2023-10-14T11:24:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.756+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b500c51b0 con 0x7f7b5006af20 2023-10-14T11:24:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.757+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b40011d40 con 0x7f7b5006af20 2023-10-14T11:24:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.757+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b500c5770 con 0x7f7b5006af20 2023-10-14T11:24:06.773 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.757+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b500728a0 con 0x7f7b5006af20 2023-10-14T11:24:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.758+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b4001a400 con 0x7f7b5006af20 2023-10-14T11:24:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.758+0000 7f7b4cff9700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7b3006af00 0x7f7b3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.758+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f7b40089870 con 0x7f7b5006af20 2023-10-14T11:24:06.774 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b4f7fe700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7b3006af00 0x7f7b3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b4cff9700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f7b30073100 0x7f7b30075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b30075c10 con 0x7f7b30073100 2023-10-14T11:24:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b40089cc0 con 0x7f7b5006af20 2023-10-14T11:24:06.775 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b54c84700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f7b30073100 0x7f7b30075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b4f7fe700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7b3006af00 0x7f7b3006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007fd0 tx=0x7f7b38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.759+0000 7f7b54c84700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f7b30073100 0x7f7b30075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.776 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.760+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== osd.2 v2:172.21.15.67:6822/192790195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7b30075c10 con 0x7f7b30073100 2023-10-14T11:24:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 --> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b500725c0 con 0x7f7b30073100 2023-10-14T11:24:06.778 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b4cff9700 1 -- 172.21.15.67:0/1571604098 <== osd.2 v2:172.21.15.67:6822/192790195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7b48003b40 con 0x7f7b30073100 2023-10-14T11:24:06.779 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:06.779 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:06.779 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f7b30073100 msgr2=0x7f7b30075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.780 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:6822/192790195,v1:172.21.15.67:6824/192790195] conn(0x7f7b30073100 0x7f7b30075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7b3006af00 msgr2=0x7f7b3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f7b3006af00 0x7f7b3006d3c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b38007fd0 tx=0x7f7b38009040 comp rx=0 tx=0).stop 2023-10-14T11:24:06.781 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 msgr2=0x7f7b500c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b566e7700 1 --2- 172.21.15.67:0/1571604098 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f7b5006af20 0x7f7b500c60f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000b4d0 tx=0x7f7b4000b890 comp rx=0 tx=0).stop 2023-10-14T11:24:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.775+0000 7f7b54c84700 1 -- 172.21.15.67:0/1571604098 reap_dead start 2023-10-14T11:24:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.776+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 shutdown_connections 2023-10-14T11:24:06.782 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.776+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 >> 172.21.15.67:0/1571604098 conn(0x7f7b5006db70 msgr2=0x7f7b500d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.776+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 shutdown_connections 2023-10-14T11:24:06.783 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.776+0000 7f7b566e7700 1 -- 172.21.15.67:0/1571604098 wait complete. 2023-10-14T11:24:06.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T11:24:06.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.913+0000 7f7604df7700 1 Processor -- start 2023-10-14T11:24:06.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.913+0000 7f7604df7700 1 -- start start 2023-10-14T11:24:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f7604df7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f760015e0c0 0x7f7600072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f7604df7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7600072ac0 con 0x7f760015e4a0 2023-10-14T11:24:06.918 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f7604df7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76000cfa80 con 0x7f76000c52c0 2023-10-14T11:24:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f7604df7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76000cfd60 con 0x7f760015e0c0 2023-10-14T11:24:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f75fdd9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f760015e4a0 0x7f76000cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42698/0 (socket says 172.21.15.67:42698) 2023-10-14T11:24:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f75fdd9b700 1 -- 172.21.15.67:0/559121060 learned_addr learned my addr 172.21.15.67:0/559121060 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:06.919 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f75fe59c700 1 --2- 172.21.15.67:0/559121060 >> v2:172.21.15.72:3300/0 conn(0x7f760015e0c0 0x7f7600072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f75fd59a700 1 -- 172.21.15.67:0/559121060 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406798102 0 0) 0x7f7600072ac0 con 0x7f760015e4a0 2023-10-14T11:24:06.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.914+0000 7f75fd59a700 1 -- 172.21.15.67:0/559121060 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e80035b0 con 0x7f760015e4a0 2023-10-14T11:24:06.920 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fe59c700 1 -- 172.21.15.67:0/559121060 >> v1:172.21.15.72:6789/0 conn(0x7f76000c52c0 legacy=0x7f760006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fe59c700 1 -- 172.21.15.67:0/559121060 >> v1:172.21.15.67:6789/0 conn(0x7f760015e4a0 legacy=0x7f76000cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fe59c700 1 -- 172.21.15.67:0/559121060 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000d0040 con 0x7f760015e0c0 2023-10-14T11:24:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fe59c700 1 --2- 172.21.15.67:0/559121060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f7600072580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009840 tx=0x7f75f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8985fcdd515ecae server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.921 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fd59a700 1 -- 172.21.15.67:0/559121060 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0001670 con 0x7f760015e0c0 2023-10-14T11:24:06.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fd59a700 1 -- 172.21.15.67:0/559121060 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4004030 con 0x7f760015e0c0 2023-10-14T11:24:06.922 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.915+0000 7f75fd59a700 1 -- 172.21.15.67:0/559121060 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40043c0 con 0x7f760015e0c0 2023-10-14T11:24:06.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 -- 172.21.15.67:0/559121060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 msgr2=0x7f7600072580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.925 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 --2- 172.21.15.67:0/559121060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f7600072580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f75f4009840 tx=0x7f75f4009b50 comp rx=0 tx=0).stop 2023-10-14T11:24:06.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 -- 172.21.15.67:0/559121060 shutdown_connections 2023-10-14T11:24:06.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 --2- 172.21.15.67:0/559121060 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f7600072580 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 -- 172.21.15.67:0/559121060 >> 172.21.15.67:0/559121060 conn(0x7f76000d0440 msgr2=0x7f76000d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:06.926 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 -- 172.21.15.67:0/559121060 shutdown_connections 2023-10-14T11:24:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.916+0000 7f7604df7700 1 -- 172.21.15.67:0/559121060 wait complete. 2023-10-14T11:24:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.917+0000 7f7604df7700 1 Processor -- start 2023-10-14T11:24:06.927 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.917+0000 7f7604df7700 1 -- start start 2023-10-14T11:24:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 0x7f76000b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f76000af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.928 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600151d20 con 0x7f760015e4a0 2023-10-14T11:24:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76000b0670 con 0x7f760015e0c0 2023-10-14T11:24:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f7604df7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76000afba0 con 0x7f76000c52c0 2023-10-14T11:24:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.929 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43414/0 (socket says 172.21.15.67:43414) 2023-10-14T11:24:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 -- 172.21.15.67:0/2000860313 learned_addr learned my addr 172.21.15.67:0/2000860313 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fe59c700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 0x7f76000b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.930 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fdd9b700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f76000af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 -- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 msgr2=0x7f76000b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 0x7f76000b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 -- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 msgr2=0x7f76000af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:06.931 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f76000af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:06.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fed9d700 1 -- 172.21.15.67:0/2000860313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40094a0 con 0x7f760015e4a0 2023-10-14T11:24:06.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.918+0000 7f75fe59c700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 0x7f76000b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:06.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f75fed9d700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c8c0 tx=0x7f75f800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.932 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8003e30 con 0x7f760015e4a0 2023-10-14T11:24:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8005070 con 0x7f760015e4a0 2023-10-14T11:24:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76000afdd0 con 0x7f760015e4a0 2023-10-14T11:24:06.933 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8005420 con 0x7f760015e4a0 2023-10-14T11:24:06.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.919+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76000b0390 con 0x7f760015e4a0 2023-10-14T11:24:06.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.920+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600151e60 con 0x7f760015e4a0 2023-10-14T11:24:06.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.920+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f75f8005580 con 0x7f760015e4a0 2023-10-14T11:24:06.934 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.921+0000 7f75eeffd700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 0x7f75e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.921+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f75f8089320 con 0x7f760015e4a0 2023-10-14T11:24:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.921+0000 7f75fe59c700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 0x7f75e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:06.935 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.921+0000 7f75fe59c700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 0x7f75e006d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75f400a010 tx=0x7f75f4008000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:06.936 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:06.925+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7600151e60 con 0x7f760015e4a0 2023-10-14T11:24:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.126+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f760006f570 con 0x7f75e006af00 2023-10-14T11:24:07.129 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.126+0000 7f75eeffd700 1 -- 172.21.15.67:0/2000860313 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75f4021070 con 0x7f75e006af00 2023-10-14T11:24:07.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 msgr2=0x7f75e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 0x7f75e006d3c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f75f400a010 tx=0x7f75f4008000 comp rx=0 tx=0).stop 2023-10-14T11:24:07.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 msgr2=0x7f76001f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.132 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c8c0 tx=0x7f75f800cbd0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 shutdown_connections 2023-10-14T11:24:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f75e006af00 0x7f75e006d3c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.133 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f760015e4a0 0x7f76001f2760 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f76000c52c0 0x7f76000b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 --2- 172.21.15.67:0/2000860313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f760015e0c0 0x7f76000af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.128+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 >> 172.21.15.67:0/2000860313 conn(0x7f76000d0440 msgr2=0x7f760006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.134 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.129+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 shutdown_connections 2023-10-14T11:24:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.129+0000 7f7604df7700 1 -- 172.21.15.67:0/2000860313 wait complete. 2023-10-14T11:24:07.135 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T11:24:07.144 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T11:24:07.144 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:07.273 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.270+0000 7f2f522d7700 1 Processor -- start 2023-10-14T11:24:07.274 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.271+0000 7f2f522d7700 1 -- start start 2023-10-14T11:24:07.276 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f522d7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f4c160fc0 0x7f2f4c0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f522d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f522d7700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c0d2320 con 0x7f2f4c1613a0 2023-10-14T11:24:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f522d7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0d27b0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.277 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f522d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0d1710 con 0x7f2f4c0b4ad0 2023-10-14T11:24:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f2f4c160fc0 0x7f2f4c0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f50874700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f2f4c1613a0 0x7f2f4c161880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42716/0 (socket says 172.21.15.67:42716) 2023-10-14T11:24:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f50874700 1 -- 172.21.15.67:0/3440929821 learned_addr learned my addr 172.21.15.67:0/3440929821 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:07.278 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4b7fe700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 -- 172.21.15.67:0/3440929821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 msgr2=0x7f2f4c0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.279 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 -- 172.21.15.67:0/3440929821 >> v1:172.21.15.67:6789/0 conn(0x7f2f4c1613a0 legacy=0x7f2f4c161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4affd700 1 -- 172.21.15.67:0/3440929821 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551804063 0 0) 0x7f2f4c0d2320 con 0x7f2f4c1613a0 2023-10-14T11:24:07.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 -- 172.21.15.67:0/3440929821 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0d19f0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4bfff700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b4590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009840 tx=0x7f2f3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfca95f03b4c8d01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.280 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.272+0000 7f2f4affd700 1 -- 172.21.15.67:0/3440929821 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011830 con 0x7f2f4c160fc0 2023-10-14T11:24:07.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f4affd700 1 -- 172.21.15.67:0/3440929821 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c011990 con 0x7f2f4c160fc0 2023-10-14T11:24:07.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f4affd700 1 -- 172.21.15.67:0/3440929821 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011d20 con 0x7f2f4c160fc0 2023-10-14T11:24:07.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 -- 172.21.15.67:0/3440929821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 msgr2=0x7f2f4c0b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.281 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b4590 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009840 tx=0x7f2f3c009b50 comp rx=0 tx=0).stop 2023-10-14T11:24:07.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 -- 172.21.15.67:0/3440929821 shutdown_connections 2023-10-14T11:24:07.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b4590 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.282 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3440929821 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 -- 172.21.15.67:0/3440929821 >> 172.21.15.67:0/3440929821 conn(0x7f2f4c09ca60 msgr2=0x7f2f4c0d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 -- 172.21.15.67:0/3440929821 shutdown_connections 2023-10-14T11:24:07.283 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.273+0000 7f2f522d7700 1 -- 172.21.15.67:0/3440929821 wait complete. 2023-10-14T11:24:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.275+0000 7f2f522d7700 1 Processor -- start 2023-10-14T11:24:07.286 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.275+0000 7f2f522d7700 1 -- start start 2023-10-14T11:24:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.287 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4c1613a0 0x7f2f4c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c14a7c0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b90d0 con 0x7f2f4c1613a0 2023-10-14T11:24:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f522d7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0cafd0 con 0x7f2f4c0b4ad0 2023-10-14T11:24:07.288 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43426/0 (socket says 172.21.15.67:43426) 2023-10-14T11:24:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 -- 172.21.15.67:0/3016309623 learned_addr learned my addr 172.21.15.67:0/3016309623 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 -- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 msgr2=0x7f2f4c149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4bfff700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f50874700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4c1613a0 0x7f2f4c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f2f4c0b4ad0 0x7f2f4c149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 -- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4c1613a0 msgr2=0x7f2f4c0b8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4c1613a0 0x7f2f4c0b8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0094a0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f50874700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2f4c1613a0 0x7f2f4c0b8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:07.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.276+0000 7f2f4b7fe700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b62f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e9d0 tx=0x7f2f3400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.277+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34009730 con 0x7f2f4c160fc0 2023-10-14T11:24:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.277+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400c850 con 0x7f2f4c160fc0 2023-10-14T11:24:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.277+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c0cb2b0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.292 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.277+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400cbe0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.277+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c0cb870 con 0x7f2f4c160fc0 2023-10-14T11:24:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.278+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f4c0d1fb0 con 0x7f2f4c160fc0 2023-10-14T11:24:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.278+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f3400cd40 con 0x7f2f4c160fc0 2023-10-14T11:24:07.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.278+0000 7f2f48ff9700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2f2c06af00 0x7f2f2c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f2f34089690 con 0x7f2f4c160fc0 2023-10-14T11:24:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f48ff9700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2f2c073100 0x7f2f2c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f2c075c10 con 0x7f2f2c073100 2023-10-14T11:24:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f3408bd50 con 0x7f2f4c160fc0 2023-10-14T11:24:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f4bfff700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2f2c06af00 0x7f2f2c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f50874700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2f2c073100 0x7f2f2c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f50874700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2f2c073100 0x7f2f2c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.279+0000 7f2f4bfff700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2f2c06af00 0x7f2f2c06d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c15d1f0 tx=0x7f2f3c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.280+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== osd.3 v2:172.21.15.67:6800/1563372793 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2f2c075c10 con 0x7f2f2c073100 2023-10-14T11:24:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 --> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2f4c0d1cd0 con 0x7f2f2c073100 2023-10-14T11:24:07.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f48ff9700 1 -- 172.21.15.67:0/3016309623 <== osd.3 v2:172.21.15.67:6800/1563372793 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2f440070f0 con 0x7f2f2c073100 2023-10-14T11:24:07.299 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:07.299 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:07.299 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:07.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2f2c073100 msgr2=0x7f2f2c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:6800/1563372793,v1:172.21.15.67:6801/1563372793] conn(0x7f2f2c073100 0x7f2f2c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2f2c06af00 msgr2=0x7f2f2c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f2f2c06af00 0x7f2f2c06d3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c15d1f0 tx=0x7f2f3c008030 comp rx=0 tx=0).stop 2023-10-14T11:24:07.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 msgr2=0x7f2f4c0b62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 --2- 172.21.15.67:0/3016309623 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f2f4c160fc0 0x7f2f4c0b62f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e9d0 tx=0x7f2f3400ed90 comp rx=0 tx=0).stop 2023-10-14T11:24:07.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f50874700 1 -- 172.21.15.67:0/3016309623 reap_dead start 2023-10-14T11:24:07.302 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 shutdown_connections 2023-10-14T11:24:07.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 >> 172.21.15.67:0/3016309623 conn(0x7f2f4c09ca60 msgr2=0x7f2f4c0b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 shutdown_connections 2023-10-14T11:24:07.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.295+0000 7f2f522d7700 1 -- 172.21.15.67:0/3016309623 wait complete. 2023-10-14T11:24:07.310 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T11:24:07.435 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 Processor -- start 2023-10-14T11:24:07.436 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 -- start start 2023-10-14T11:24:07.438 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4ec1610f0 0x7fd4ec1617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec0d2330 0x7fd4ec162170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.439 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0ce360 con 0x7fd4ec161d10 2023-10-14T11:24:07.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0d00c0 con 0x7fd4ec1610f0 2023-10-14T11:24:07.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4f16b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0d03a0 con 0x7fd4ec0d2330 2023-10-14T11:24:07.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.433+0000 7fd4eaffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4ec1610f0 0x7fd4ec1617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.440 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fd4ec1610f0 0x7fd4ec1617d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43434/0 (socket says 172.21.15.67:43434) 2023-10-14T11:24:07.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 -- 172.21.15.67:0/2147299381 learned_addr learned my addr 172.21.15.67:0/2147299381 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:07.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eb7fe700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec0d2330 0x7fd4ec162170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.441 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 -- 172.21.15.67:0/2147299381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec0d2330 msgr2=0x7fd4ec162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec0d2330 0x7fd4ec162170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 -- 172.21.15.67:0/2147299381 >> v1:172.21.15.72:6789/0 conn(0x7fd4ec161d10 legacy=0x7fd4ec0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 -- 172.21.15.67:0/2147299381 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0d0680 con 0x7fd4ec1610f0 2023-10-14T11:24:07.442 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec1610f0 0x7fd4ec1617d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0d484331d2d40f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4e9ffb700 1 -- 172.21.15.67:0/2147299381 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005e30 con 0x7fd4ec1610f0 2023-10-14T11:24:07.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4e9ffb700 1 -- 172.21.15.67:0/2147299381 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc004030 con 0x7fd4ec1610f0 2023-10-14T11:24:07.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.434+0000 7fd4e9ffb700 1 -- 172.21.15.67:0/2147299381 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0043e0 con 0x7fd4ec1610f0 2023-10-14T11:24:07.443 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 -- 172.21.15.67:0/2147299381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec1610f0 msgr2=0x7fd4ec1617d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec1610f0 0x7fd4ec1617d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc009bd0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 -- 172.21.15.67:0/2147299381 shutdown_connections 2023-10-14T11:24:07.444 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec0d2330 0x7fd4ec162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/2147299381 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec1610f0 0x7fd4ec1617d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 -- 172.21.15.67:0/2147299381 >> 172.21.15.67:0/2147299381 conn(0x7fd4ec09cab0 msgr2=0x7fd4ec0d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 -- 172.21.15.67:0/2147299381 shutdown_connections 2023-10-14T11:24:07.445 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.435+0000 7fd4f16b6700 1 -- 172.21.15.67:0/2147299381 wait complete. 2023-10-14T11:24:07.448 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.436+0000 7fd4f16b6700 1 Processor -- start 2023-10-14T11:24:07.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.436+0000 7fd4f16b6700 1 -- start start 2023-10-14T11:24:07.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 0x7fd4ec1f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.449 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec1610f0 0x7fd4ec0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a1350 con 0x7fd4ec161d10 2023-10-14T11:24:07.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec1f7940 con 0x7fd4ec0d2330 2023-10-14T11:24:07.450 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4f16b6700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec1f6b80 con 0x7fd4ec1610f0 2023-10-14T11:24:07.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43444/0 (socket says 172.21.15.67:43444) 2023-10-14T11:24:07.451 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 -- 172.21.15.67:0/254454847 learned_addr learned my addr 172.21.15.67:0/254454847 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:07.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 0x7fd4ec1f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 -- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec1610f0 msgr2=0x7fd4ec0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4ea7fc700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec1610f0 0x7fd4ec0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.452 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec1610f0 0x7fd4ec0b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 -- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 msgr2=0x7fd4ec1f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 0x7fd4ec1f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eb7fe700 1 -- 172.21.15.67:0/254454847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc009500 con 0x7fd4ec161d10 2023-10-14T11:24:07.453 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.437+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 0x7fd4ec1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:07.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4eb7fe700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400efc0 tx=0x7fd4e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4009ba0 con 0x7fd4ec161d10 2023-10-14T11:24:07.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400f040 con 0x7fd4ec161d10 2023-10-14T11:24:07.454 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec1f6e60 con 0x7fd4ec161d10 2023-10-14T11:24:07.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4014480 con 0x7fd4ec161d10 2023-10-14T11:24:07.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.438+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec1f7420 con 0x7fd4ec161d10 2023-10-14T11:24:07.455 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.439+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec04ebb0 con 0x7fd4ec161d10 2023-10-14T11:24:07.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.439+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd4e40145e0 con 0x7fd4ec161d10 2023-10-14T11:24:07.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.440+0000 7fd4e37fe700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 0x7fd4cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.440+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fd4e408a160 con 0x7fd4ec161d10 2023-10-14T11:24:07.456 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.440+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 0x7fd4cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.440+0000 7fd4eaffd700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 0x7fd4cc06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc008070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.457 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.444+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd4e40551e0 con 0x7fd4ec161d10 2023-10-14T11:24:07.649 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.646+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4ec1f6cf0 con 0x7fd4cc06af00 2023-10-14T11:24:07.650 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.647+0000 7fd4e37fe700 1 -- 172.21.15.67:0/254454847 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd4ec1f6cf0 con 0x7fd4cc06af00 2023-10-14T11:24:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.649+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 msgr2=0x7fd4cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.649+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 0x7fd4cc06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc008070 comp rx=0 tx=0).stop 2023-10-14T11:24:07.653 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.649+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 msgr2=0x7fd4ec0b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.649+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400efc0 tx=0x7fd4e400c3a0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 shutdown_connections 2023-10-14T11:24:07.654 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fd4cc06af00 0x7fd4cc06d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fd4ec161d10 0x7fd4ec0b15d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd4ec0d2330 0x7fd4ec1f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 --2- 172.21.15.67:0/254454847 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fd4ec1610f0 0x7fd4ec0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.655 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 >> 172.21.15.67:0/254454847 conn(0x7fd4ec09cab0 msgr2=0x7fd4ec0ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 shutdown_connections 2023-10-14T11:24:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.650+0000 7fd4f16b6700 1 -- 172.21.15.67:0/254454847 wait complete. 2023-10-14T11:24:07.656 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T11:24:07.665 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T11:24:07.665 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:07.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.792+0000 7f3eb0187700 1 Processor -- start 2023-10-14T11:24:07.795 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.792+0000 7f3eb0187700 1 -- start start 2023-10-14T11:24:07.797 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eb0187700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ea80b3690 0x7f3ea80cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eb0187700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3ea80b71c0 0x7f3ea80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eb0187700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea815f580 con 0x7f3ea815b910 2023-10-14T11:24:07.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eb0187700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea8160200 con 0x7f3ea80b3690 2023-10-14T11:24:07.798 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eb0187700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea815f860 con 0x7f3ea80b71c0 2023-10-14T11:24:07.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3ea80b3690 0x7f3ea80cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eadf23700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3ea815b910 0x7f3ea80b2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42742/0 (socket says 172.21.15.67:42742) 2023-10-14T11:24:07.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eadf23700 1 -- 172.21.15.67:0/1340917862 learned_addr learned my addr 172.21.15.67:0/1340917862 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:07.799 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 -- 172.21.15.67:0/1340917862 >> v2:172.21.15.72:3300/0 conn(0x7f3ea80b71c0 msgr2=0x7f3ea80cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 --2- 172.21.15.67:0/1340917862 >> v2:172.21.15.72:3300/0 conn(0x7f3ea80b71c0 0x7f3ea80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 -- 172.21.15.67:0/1340917862 >> v1:172.21.15.67:6789/0 conn(0x7f3ea815b910 legacy=0x7f3ea80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.800 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 -- 172.21.15.67:0/1340917862 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea815fb40 con 0x7f3ea80b3690 2023-10-14T11:24:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3eacf21700 1 -- 172.21.15.67:0/1340917862 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268141279 0 0) 0x7f3ea815f580 con 0x7f3ea815b910 2023-10-14T11:24:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.793+0000 7f3ead722700 1 --2- 172.21.15.67:0/1340917862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b3690 0x7f3ea80cf3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80b3fb0 tx=0x7f3ea4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e589203388c23a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eacf21700 1 -- 172.21.15.67:0/1340917862 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011830 con 0x7f3ea80b3690 2023-10-14T11:24:07.801 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eacf21700 1 -- 172.21.15.67:0/1340917862 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011990 con 0x7f3ea80b3690 2023-10-14T11:24:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eacf21700 1 -- 172.21.15.67:0/1340917862 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011d20 con 0x7f3ea80b3690 2023-10-14T11:24:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 -- 172.21.15.67:0/1340917862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b3690 msgr2=0x7f3ea80cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 --2- 172.21.15.67:0/1340917862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b3690 0x7f3ea80cf3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80b3fb0 tx=0x7f3ea4009b20 comp rx=0 tx=0).stop 2023-10-14T11:24:07.802 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 -- 172.21.15.67:0/1340917862 shutdown_connections 2023-10-14T11:24:07.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 --2- 172.21.15.67:0/1340917862 >> v2:172.21.15.72:3300/0 conn(0x7f3ea80b71c0 0x7f3ea80cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 --2- 172.21.15.67:0/1340917862 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b3690 0x7f3ea80cf3c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.803 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 -- 172.21.15.67:0/1340917862 >> 172.21.15.67:0/1340917862 conn(0x7f3ea80cdf80 msgr2=0x7f3ea80ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 -- 172.21.15.67:0/1340917862 shutdown_connections 2023-10-14T11:24:07.804 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.794+0000 7f3eb0187700 1 -- 172.21.15.67:0/1340917862 wait complete. 2023-10-14T11:24:07.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.795+0000 7f3eb0187700 1 Processor -- start 2023-10-14T11:24:07.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.795+0000 7f3eb0187700 1 -- start start 2023-10-14T11:24:07.807 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ea80b3690 0x7f3ea81f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 0x7f3ea81f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ea815b910 0x7f3ea81f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea806d170 con 0x7f3ea80b71c0 2023-10-14T11:24:07.808 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea806c2e0 con 0x7f3ea815b910 2023-10-14T11:24:07.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eb0187700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea806c560 con 0x7f3ea80b3690 2023-10-14T11:24:07.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3ead722700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 0x7f3ea81f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3ead722700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 0x7f3ea81f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43456/0 (socket says 172.21.15.67:43456) 2023-10-14T11:24:07.809 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3ead722700 1 -- 172.21.15.67:0/1283189943 learned_addr learned my addr 172.21.15.67:0/1283189943 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3eadf23700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ea80b3690 0x7f3ea81f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.796+0000 7f3eae724700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ea815b910 0x7f3ea81f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.810 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 -- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ea80b3690 msgr2=0x7f3ea81f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3ea80b3690 0x7f3ea81f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 -- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ea815b910 msgr2=0x7f3ea81f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3ea815b910 0x7f3ea81f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.811 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40094a0 con 0x7f3ea80b71c0 2023-10-14T11:24:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3ead722700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 0x7f3ea81f6560 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4014040 tx=0x7f3ea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40038a0 con 0x7f3ea80b71c0 2023-10-14T11:24:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea401e070 con 0x7f3ea80b71c0 2023-10-14T11:24:07.812 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4003c60 con 0x7f3ea80b71c0 2023-10-14T11:24:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3eb0187700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea806c840 con 0x7f3ea80b71c0 2023-10-14T11:24:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.797+0000 7f3eb0187700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea806ce00 con 0x7f3ea80b71c0 2023-10-14T11:24:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.798+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e84000fc0 con 0x7f3ea80b71c0 2023-10-14T11:24:07.813 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.798+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ea402d450 con 0x7f3ea80b71c0 2023-10-14T11:24:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3e9e7fc700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3e8c06af00 0x7f3e8c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3ea408a6f0 con 0x7f3ea80b71c0 2023-10-14T11:24:07.814 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3eadf23700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3e8c06af00 0x7f3e8c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3e9e7fc700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7f3e8c073100 0x7f3e8c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e8c075c10 con 0x7f3e8c073100 2023-10-14T11:24:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea408cdb0 con 0x7f3ea80b71c0 2023-10-14T11:24:07.815 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.799+0000 7f3eae724700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7f3e8c073100 0x7f3e8c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.800+0000 7f3eadf23700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3e8c06af00 0x7f3e8c06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e98000f60 tx=0x7f3e98007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.800+0000 7f3eae724700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7f3e8c073100 0x7f3e8c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.816 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.800+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== osd.4 v2:172.21.15.72:6800/3701848169 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3e8c075c10 con 0x7f3e8c073100 2023-10-14T11:24:07.818 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.815+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 --> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3e84002d60 con 0x7f3e8c073100 2023-10-14T11:24:07.819 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e9e7fc700 1 -- 172.21.15.67:0/1283189943 <== osd.4 v2:172.21.15.72:6800/3701848169 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3e84002d60 con 0x7f3e8c073100 2023-10-14T11:24:07.819 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:07.820 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:07.820 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:07.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7f3e8c073100 msgr2=0x7f3e8c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.821 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6800/3701848169,v1:172.21.15.72:6801/3701848169] conn(0x7f3e8c073100 0x7f3e8c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3e8c06af00 msgr2=0x7f3e8c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3e8c06af00 0x7f3e8c06d3c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e98000f60 tx=0x7f3e98007be0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.822 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 msgr2=0x7f3ea81f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 --2- 172.21.15.67:0/1283189943 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3ea80b71c0 0x7f3ea81f6560 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4014040 tx=0x7f3ea4004750 comp rx=0 tx=0).stop 2023-10-14T11:24:07.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3eae724700 1 -- 172.21.15.67:0/1283189943 reap_dead start 2023-10-14T11:24:07.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 shutdown_connections 2023-10-14T11:24:07.823 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 >> 172.21.15.67:0/1283189943 conn(0x7f3ea80cdf80 msgr2=0x7f3ea80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 shutdown_connections 2023-10-14T11:24:07.824 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.816+0000 7f3e8bfff700 1 -- 172.21.15.67:0/1283189943 wait complete. 2023-10-14T11:24:07.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T11:24:07.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.954+0000 7fc421316700 1 Processor -- start 2023-10-14T11:24:07.957 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.954+0000 7fc421316700 1 -- start start 2023-10-14T11:24:07.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc421316700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc41c1617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc421316700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0ce360 con 0x7fc41c0d2330 2023-10-14T11:24:07.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc421316700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c0d00c0 con 0x7fc41c161d10 2023-10-14T11:24:07.961 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc421316700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0d03a0 con 0x7fc41c1610f0 2023-10-14T11:24:07.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc41b7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fc41c0d2330 0x7fc41c0cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42762/0 (socket says 172.21.15.67:42762) 2023-10-14T11:24:07.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc41b7fe700 1 -- 172.21.15.67:0/1480017174 learned_addr learned my addr 172.21.15.67:0/1480017174 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:07.962 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841870630 0 0) 0x7fc41c0ce360 con 0x7fc41c0d2330 2023-10-14T11:24:07.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc41affd700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc41c1617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4040035b0 con 0x7fc41c0d2330 2023-10-14T11:24:07.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506506293 0 0) 0x7fc41c0d00c0 con 0x7fc41c161d10 2023-10-14T11:24:07.963 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc41c0ce360 con 0x7fc41c161d10 2023-10-14T11:24:07.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 384100607 0 0) 0x7fc4040035b0 con 0x7fc41c0d2330 2023-10-14T11:24:07.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 msgr2=0x7fc41c1617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc41c1617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.964 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 >> v1:172.21.15.72:6789/0 conn(0x7fc41c161d10 legacy=0x7fc41c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0d0680 con 0x7fc41c0d2330 2023-10-14T11:24:07.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7fc4140019f0 con 0x7fc41c0d2330 2023-10-14T11:24:07.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 >> v1:172.21.15.67:6789/0 conn(0x7fc41c0d2330 legacy=0x7fc41c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.965 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.955+0000 7fc419ffb700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc404003bc0 0x7fc404003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404004850 0x7fc404004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc404005310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.966 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0d03a0 con 0x7fc404003bc0 2023-10-14T11:24:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400bc10 con 0x7fc404004850 2023-10-14T11:24:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400bdd0 con 0x7fc41c1610f0 2023-10-14T11:24:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc404003bc0 0x7fc404003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.967 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41a7fc700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404004850 0x7fc404004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41b7fe700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc404005310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 -- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 msgr2=0x7fc404005310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c1610f0 0x7fc404005310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.968 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 -- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404004850 msgr2=0x7fc404004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:07.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404004850 0x7fc404004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 -- 172.21.15.67:0/1480017174 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040035b0 con 0x7fc404003bc0 2023-10-14T11:24:07.969 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc41affd700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc404003bc0 0x7fc404003fc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc410009b40 tx=0x7fc404005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc17aa131ae2446 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410005a20 con 0x7fc404003bc0 2023-10-14T11:24:07.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410005b80 con 0x7fc404003bc0 2023-10-14T11:24:07.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.956+0000 7fc419ffb700 1 -- 172.21.15.67:0/1480017174 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000e6c0 con 0x7fc404003bc0 2023-10-14T11:24:07.970 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 -- 172.21.15.67:0/1480017174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc404003bc0 msgr2=0x7fc404003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 --2- 172.21.15.67:0/1480017174 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc404003bc0 0x7fc404003fc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc410009b40 tx=0x7fc404005880 comp rx=0 tx=0).stop 2023-10-14T11:24:07.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc41b7fe700 1 -- 172.21.15.67:0/1480017174 reap_dead start 2023-10-14T11:24:07.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 -- 172.21.15.67:0/1480017174 shutdown_connections 2023-10-14T11:24:07.971 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 -- 172.21.15.67:0/1480017174 >> 172.21.15.67:0/1480017174 conn(0x7fc41c09cab0 msgr2=0x7fc41c0d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:07.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 -- 172.21.15.67:0/1480017174 shutdown_connections 2023-10-14T11:24:07.972 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.957+0000 7fc421316700 1 -- 172.21.15.67:0/1480017174 wait complete. 2023-10-14T11:24:07.974 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.958+0000 7fc421316700 1 Processor -- start 2023-10-14T11:24:07.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.958+0000 7fc421316700 1 -- start start 2023-10-14T11:24:07.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404003bc0 0x7fc41c0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c156da0 0x7fc41c0b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.975 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0ccca0 con 0x7fc41c157220 2023-10-14T11:24:07.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0cd670 con 0x7fc404003bc0 2023-10-14T11:24:07.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc421316700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0cc090 con 0x7fc41c156da0 2023-10-14T11:24:07.976 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43480/0 (socket says 172.21.15.67:43480) 2023-10-14T11:24:07.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 -- 172.21.15.67:0/2224745909 learned_addr learned my addr 172.21.15.67:0/2224745909 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:07.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 -- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c156da0 msgr2=0x7fc41c0b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.977 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41a7fc700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c156da0 0x7fc41c0b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41affd700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404003bc0 0x7fc41c0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c156da0 0x7fc41c0b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 -- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404003bc0 msgr2=0x7fc41c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:07.978 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404003bc0 0x7fc41c0cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:07.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 -- 172.21.15.67:0/2224745909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0cc370 con 0x7fc41c157220 2023-10-14T11:24:07.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.959+0000 7fc41b7fe700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc41c08b1f0 tx=0x7fc41400a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.960+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400ad40 con 0x7fc41c157220 2023-10-14T11:24:07.979 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.960+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4140133f0 con 0x7fc41c157220 2023-10-14T11:24:07.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.960+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41400aea0 con 0x7fc41c157220 2023-10-14T11:24:07.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.960+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0cc650 con 0x7fc41c157220 2023-10-14T11:24:07.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.960+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0cbc20 con 0x7fc41c157220 2023-10-14T11:24:07.980 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.961+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c0cbde0 con 0x7fc41c157220 2023-10-14T11:24:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.961+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4140137a0 con 0x7fc41c157220 2023-10-14T11:24:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.962+0000 7fc4037fe700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 0x7fc40806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:07.981 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.962+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc414089ea0 con 0x7fc41c157220 2023-10-14T11:24:07.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.962+0000 7fc41affd700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 0x7fc40806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:07.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.962+0000 7fc41affd700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 0x7fc40806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc410000c00 tx=0x7fc410008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:07.982 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:07.966+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc414054f30 con 0x7fc41c157220 2023-10-14T11:24:08.167 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.164+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc41c1614d0 con 0x7fc40806af00 2023-10-14T11:24:08.168 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.165+0000 7fc4037fe700 1 -- 172.21.15.67:0/2224745909 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc410005d70 con 0x7fc40806af00 2023-10-14T11:24:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 msgr2=0x7fc40806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 0x7fc40806d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc410000c00 tx=0x7fc410008030 comp rx=0 tx=0).stop 2023-10-14T11:24:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 msgr2=0x7fc41c0b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.171 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc41c08b1f0 tx=0x7fc41400a510 comp rx=0 tx=0).stop 2023-10-14T11:24:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 shutdown_connections 2023-10-14T11:24:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fc40806af00 0x7fc40806d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.172 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fc41c157220 0x7fc41c0b7f40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc404003bc0 0x7fc41c0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 --2- 172.21.15.67:0/2224745909 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fc41c156da0 0x7fc41c0b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 >> 172.21.15.67:0/2224745909 conn(0x7fc41c09cab0 msgr2=0x7fc41c06c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.173 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.167+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 shutdown_connections 2023-10-14T11:24:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.168+0000 7fc421316700 1 -- 172.21.15.67:0/2224745909 wait complete. 2023-10-14T11:24:08.174 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T11:24:08.183 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T11:24:08.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.310+0000 7f3fc919f700 1 Processor -- start 2023-10-14T11:24:08.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.310+0000 7f3fc919f700 1 -- start start 2023-10-14T11:24:08.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc919f700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fc40cc850 0x7f3fc406daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc919f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40ca860 con 0x7f3fc406af20 2023-10-14T11:24:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc919f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc415db60 con 0x7f3fc415d780 2023-10-14T11:24:08.316 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc919f700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40cda40 con 0x7f3fc40cc850 2023-10-14T11:24:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc899e700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3fc40cc850 0x7f3fc406daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc37fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f3fc406af20 0x7f3fc4071ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42780/0 (socket says 172.21.15.67:42780) 2023-10-14T11:24:08.317 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc37fe700 1 -- 172.21.15.67:0/2921567248 learned_addr learned my addr 172.21.15.67:0/2921567248 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc899e700 1 -- 172.21.15.67:0/2921567248 >> v1:172.21.15.72:6789/0 conn(0x7f3fc415d780 legacy=0x7f3fc406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc899e700 1 -- 172.21.15.67:0/2921567248 >> v1:172.21.15.67:6789/0 conn(0x7f3fc406af20 legacy=0x7f3fc4071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.318 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc899e700 1 -- 172.21.15.67:0/2921567248 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40ccdc0 con 0x7f3fc40cc850 2023-10-14T11:24:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc2ffd700 1 -- 172.21.15.67:0/2921567248 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603191261 0 0) 0x7f3fc40ca860 con 0x7f3fc406af20 2023-10-14T11:24:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.311+0000 7f3fc899e700 1 --2- 172.21.15.67:0/2921567248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc40cc850 0x7f3fc406daf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009d90 tx=0x7f3fbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7eeef6a7053fa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc2ffd700 1 -- 172.21.15.67:0/2921567248 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00e070 con 0x7f3fc40cc850 2023-10-14T11:24:08.319 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc2ffd700 1 -- 172.21.15.67:0/2921567248 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00bb90 con 0x7f3fc40cc850 2023-10-14T11:24:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc2ffd700 1 -- 172.21.15.67:0/2921567248 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc003a20 con 0x7f3fc40cc850 2023-10-14T11:24:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 -- 172.21.15.67:0/2921567248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc40cc850 msgr2=0x7f3fc406daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 --2- 172.21.15.67:0/2921567248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc40cc850 0x7f3fc406daf0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009d90 tx=0x7f3fbc00b330 comp rx=0 tx=0).stop 2023-10-14T11:24:08.320 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 -- 172.21.15.67:0/2921567248 shutdown_connections 2023-10-14T11:24:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 --2- 172.21.15.67:0/2921567248 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc40cc850 0x7f3fc406daf0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 -- 172.21.15.67:0/2921567248 >> 172.21.15.67:0/2921567248 conn(0x7f3fc406f3e0 msgr2=0x7f3fc406f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 -- 172.21.15.67:0/2921567248 shutdown_connections 2023-10-14T11:24:08.321 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.312+0000 7f3fc919f700 1 -- 172.21.15.67:0/2921567248 wait complete. 2023-10-14T11:24:08.324 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.313+0000 7f3fc919f700 1 Processor -- start 2023-10-14T11:24:08.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 -- start start 2023-10-14T11:24:08.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc406af20 0x7f3fc415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fc40cc850 0x7f3fc40adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.325 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 0x7f3fc40c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40b4d60 con 0x7f3fc415d780 2023-10-14T11:24:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc415e230 con 0x7f3fc406af20 2023-10-14T11:24:08.326 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.314+0000 7f3fc919f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40c4730 con 0x7f3fc40cc850 2023-10-14T11:24:08.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 0x7f3fc40c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 0x7f3fc40c6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43492/0 (socket says 172.21.15.67:43492) 2023-10-14T11:24:08.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 -- 172.21.15.67:0/870625764 learned_addr learned my addr 172.21.15.67:0/870625764 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:08.327 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc3fff700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc406af20 0x7f3fc415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc37fe700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fc40cc850 0x7f3fc40adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 -- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fc40cc850 msgr2=0x7f3fc40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3fc40cc850 0x7f3fc40adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.328 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 -- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc406af20 msgr2=0x7f3fc415dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3fc406af20 0x7f3fc415dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc009a70 con 0x7f3fc415d780 2023-10-14T11:24:08.329 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc899e700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 0x7f3fc40c6430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b730 tx=0x7f3fbc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc012630 con 0x7f3fc415d780 2023-10-14T11:24:08.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc0127b0 con 0x7f3fc415d780 2023-10-14T11:24:08.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40c4980 con 0x7f3fc415d780 2023-10-14T11:24:08.330 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc012b60 con 0x7f3fc415d780 2023-10-14T11:24:08.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.315+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc40b4980 con 0x7f3fc415d780 2023-10-14T11:24:08.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.316+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fc40cd380 con 0x7f3fc415d780 2023-10-14T11:24:08.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3fbc01d420 con 0x7f3fc415d780 2023-10-14T11:24:08.331 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3fb006af00 0x7f3fb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3fbc08be40 con 0x7f3fc415d780 2023-10-14T11:24:08.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f3fb0073100 0x7f3fb0075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fb0075c10 con 0x7f3fb0073100 2023-10-14T11:24:08.332 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fbc08c290 con 0x7f3fc415d780 2023-10-14T11:24:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.317+0000 7f3fc3fff700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3fb006af00 0x7f3fb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.318+0000 7f3fc37fe700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f3fb0073100 0x7f3fb0075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.318+0000 7f3fc3fff700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3fb006af00 0x7f3fb006d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8007fd0 tx=0x7f3fb8007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.333 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.318+0000 7f3fc37fe700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f3fb0073100 0x7f3fb0075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.334 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.319+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== osd.5 v2:172.21.15.72:6824/144247410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f3fb0075c10 con 0x7f3fb0073100 2023-10-14T11:24:08.336 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.334+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 --> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fc40cd0a0 con 0x7f3fb0073100 2023-10-14T11:24:08.337 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.334+0000 7f3fc0ff9700 1 -- 172.21.15.67:0/870625764 <== osd.5 v2:172.21.15.72:6824/144247410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3fb4004ab0 con 0x7f3fb0073100 2023-10-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:08.338 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.334+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f3fb0073100 msgr2=0x7f3fb0075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.339 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.334+0000 7f3fc919f700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6824/144247410,v1:172.21.15.72:6825/144247410] conn(0x7f3fb0073100 0x7f3fb0075540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3fb006af00 msgr2=0x7f3fb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3fb006af00 0x7f3fb006d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8007fd0 tx=0x7f3fb8007ec0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.340 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 msgr2=0x7f3fc40c6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 --2- 172.21.15.67:0/870625764 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3fc415d780 0x7f3fc40c6430 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00b730 tx=0x7f3fbc004ad0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc899e700 1 -- 172.21.15.67:0/870625764 reap_dead start 2023-10-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 shutdown_connections 2023-10-14T11:24:08.341 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 >> 172.21.15.67:0/870625764 conn(0x7f3fc406f3e0 msgr2=0x7f3fc406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 shutdown_connections 2023-10-14T11:24:08.342 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.335+0000 7f3fc919f700 1 -- 172.21.15.67:0/870625764 wait complete. 2023-10-14T11:24:08.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T11:24:08.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.472+0000 7f97eee35700 1 Processor -- start 2023-10-14T11:24:08.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.472+0000 7f97eee35700 1 -- start start 2023-10-14T11:24:08.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97eee35700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97e815def0 0x7f97e806d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97eee35700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e806cdd0 con 0x7f97e80cfe80 2023-10-14T11:24:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97eee35700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e806c1c0 con 0x7f97e8161fe0 2023-10-14T11:24:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97eee35700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e806c4a0 con 0x7f97e815def0 2023-10-14T11:24:08.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97ecbd1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97e815def0 0x7f97e806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97ecbd1700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f97e815def0 0x7f97e806d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43500/0 (socket says 172.21.15.67:43500) 2023-10-14T11:24:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97e7fff700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f97e80cfe80 0x7f97e81618d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42794/0 (socket says 172.21.15.67:42794) 2023-10-14T11:24:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.473+0000 7f97ecbd1700 1 -- 172.21.15.67:0/1152757043 learned_addr learned my addr 172.21.15.67:0/1152757043 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:08.480 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97ecbd1700 1 -- 172.21.15.67:0/1152757043 >> v1:172.21.15.72:6789/0 conn(0x7f97e8161fe0 legacy=0x7f97e815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97ecbd1700 1 -- 172.21.15.67:0/1152757043 >> v1:172.21.15.67:6789/0 conn(0x7f97e80cfe80 legacy=0x7f97e81618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97ecbd1700 1 -- 172.21.15.67:0/1152757043 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e806c780 con 0x7f97e815def0 2023-10-14T11:24:08.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97e77fe700 1 -- 172.21.15.67:0/1152757043 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700582392 0 0) 0x7f97e806cdd0 con 0x7f97e80cfe80 2023-10-14T11:24:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97ecbd1700 1 --2- 172.21.15.67:0/1152757043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e806d260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0098f0 tx=0x7f97dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3f4825cc370e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97e77fe700 1 -- 172.21.15.67:0/1152757043 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00b8a0 con 0x7f97e815def0 2023-10-14T11:24:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97e77fe700 1 -- 172.21.15.67:0/1152757043 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc00ba00 con 0x7f97e815def0 2023-10-14T11:24:08.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97e77fe700 1 -- 172.21.15.67:0/1152757043 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00bd90 con 0x7f97e815def0 2023-10-14T11:24:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97eee35700 1 -- 172.21.15.67:0/1152757043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 msgr2=0x7f97e806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97eee35700 1 --2- 172.21.15.67:0/1152757043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e806d260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0098f0 tx=0x7f97dc009c00 comp rx=0 tx=0).stop 2023-10-14T11:24:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97eee35700 1 -- 172.21.15.67:0/1152757043 shutdown_connections 2023-10-14T11:24:08.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97eee35700 1 --2- 172.21.15.67:0/1152757043 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e806d260 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.474+0000 7f97eee35700 1 -- 172.21.15.67:0/1152757043 >> 172.21.15.67:0/1152757043 conn(0x7f97e80d1570 msgr2=0x7f97e80d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.475+0000 7f97eee35700 1 -- 172.21.15.67:0/1152757043 shutdown_connections 2023-10-14T11:24:08.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.475+0000 7f97eee35700 1 -- 172.21.15.67:0/1152757043 wait complete. 2023-10-14T11:24:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.476+0000 7f97eee35700 1 Processor -- start 2023-10-14T11:24:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.476+0000 7f97eee35700 1 -- start start 2023-10-14T11:24:08.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e80cfe80 0x7f97e81559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 0x7f97e80b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80c5e90 con 0x7f97e815def0 2023-10-14T11:24:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80b5850 con 0x7f97e80cfe80 2023-10-14T11:24:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97eee35700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80b5b30 con 0x7f97e8161fe0 2023-10-14T11:24:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43508/0 (socket says 172.21.15.67:43508) 2023-10-14T11:24:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 -- 172.21.15.67:0/666008266 learned_addr learned my addr 172.21.15.67:0/666008266 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97ecbd1700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e80cfe80 0x7f97e81559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97ed3d2700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 0x7f97e80b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 -- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 msgr2=0x7f97e80b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 0x7f97e80b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 -- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e80cfe80 msgr2=0x7f97e81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e80cfe80 0x7f97e81559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 -- 172.21.15.67:0/666008266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009550 con 0x7f97e815def0 2023-10-14T11:24:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97ed3d2700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 0x7f97e80b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:08.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e7fff700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c520 tx=0x7f97d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4004c80 con 0x7f97e815def0 2023-10-14T11:24:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.477+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d4004de0 con 0x7f97e815def0 2023-10-14T11:24:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.478+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e80b5e10 con 0x7f97e815def0 2023-10-14T11:24:08.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.478+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4007310 con 0x7f97e815def0 2023-10-14T11:24:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.478+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e8155f00 con 0x7f97e815def0 2023-10-14T11:24:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.478+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e80c6350 con 0x7f97e815def0 2023-10-14T11:24:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.479+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97d4007470 con 0x7f97e815def0 2023-10-14T11:24:08.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.479+0000 7f97e57fa700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 0x7f97cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.479+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f97d4089240 con 0x7f97e815def0 2023-10-14T11:24:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.479+0000 7f97ecbd1700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 0x7f97cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.495 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.480+0000 7f97ecbd1700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 0x7f97cc06d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.484+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97e80c6350 con 0x7f97e815def0 2023-10-14T11:24:08.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.685+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f97e80b0a00 con 0x7f97cc06af00 2023-10-14T11:24:08.689 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.685+0000 7f97e57fa700 1 -- 172.21.15.67:0/666008266 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f97dc00bbf0 con 0x7f97cc06af00 2023-10-14T11:24:08.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 msgr2=0x7f97cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 0x7f97cc06d3c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc008030 comp rx=0 tx=0).stop 2023-10-14T11:24:08.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 msgr2=0x7f97e80b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f97d400c520 tx=0x7f97d400c830 comp rx=0 tx=0).stop 2023-10-14T11:24:08.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 shutdown_connections 2023-10-14T11:24:08.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f97e8161fe0 0x7f97e80b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97e80cfe80 0x7f97e81559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f97cc06af00 0x7f97cc06d3c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 --2- 172.21.15.67:0/666008266 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f97e815def0 0x7f97e80b2cc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 >> 172.21.15.67:0/666008266 conn(0x7f97e80d1570 msgr2=0x7f97e80d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 shutdown_connections 2023-10-14T11:24:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.687+0000 7f97eee35700 1 -- 172.21.15.67:0/666008266 wait complete. 2023-10-14T11:24:08.694 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T11:24:08.702 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T11:24:08.703 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:08.831 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.828+0000 7f24c075e700 1 Processor -- start 2023-10-14T11:24:08.832 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.828+0000 7f24c075e700 1 -- start start 2023-10-14T11:24:08.834 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24c075e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24b8071b70 0x7f24b8161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24c075e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 0x7f24b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24c075e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b8162440 con 0x7f24b815d8d0 2023-10-14T11:24:08.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24c075e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b8070320 con 0x7f24b8071b70 2023-10-14T11:24:08.835 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24c075e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b8072000 con 0x7f24b806af20 2023-10-14T11:24:08.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24bdcf9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24b8071b70 0x7f24b8161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.829+0000 7f24becfb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 0x7f24b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.836 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24becfb700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 0x7f24b80b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:45790/0 (socket says 172.21.15.67:45790) 2023-10-14T11:24:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f24b8071b70 0x7f24b8161f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:43924/0 (socket says 172.21.15.67:43924) 2023-10-14T11:24:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24becfb700 1 -- 172.21.15.67:0/2742856794 learned_addr learned my addr 172.21.15.67:0/2742856794 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24be4fa700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24b815d8d0 0x7f24b806a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:49630/0 (socket says 172.21.15.67:49630) 2023-10-14T11:24:08.837 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 -- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 msgr2=0x7f24b80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:08.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 0x7f24b80b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 -- 172.21.15.67:0/2742856794 >> v1:172.21.15.72:6789/0 conn(0x7f24b815d8d0 legacy=0x7f24b806a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.838 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 -- 172.21.15.67:0/2742856794 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80722e0 con 0x7f24b8071b70 2023-10-14T11:24:08.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bd4f8700 1 -- 172.21.15.67:0/2742856794 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972034094 0 0) 0x7f24a8001110 con 0x7f24b815d8d0 2023-10-14T11:24:08.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8071b70 0x7f24b8161f00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009840 tx=0x7f24b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab640fefbf4b78b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bd4f8700 1 -- 172.21.15.67:0/2742856794 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011830 con 0x7f24b8071b70 2023-10-14T11:24:08.839 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bd4f8700 1 -- 172.21.15.67:0/2742856794 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4011990 con 0x7f24b8071b70 2023-10-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.830+0000 7f24bd4f8700 1 -- 172.21.15.67:0/2742856794 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011d20 con 0x7f24b8071b70 2023-10-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 -- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8071b70 msgr2=0x7f24b8161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 --2- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8071b70 0x7f24b8161f00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009840 tx=0x7f24b4009b50 comp rx=0 tx=0).stop 2023-10-14T11:24:08.840 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 -- 172.21.15.67:0/2742856794 shutdown_connections 2023-10-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 --2- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b806af20 0x7f24b80b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 --2- 172.21.15.67:0/2742856794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8071b70 0x7f24b8161f00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.841 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 -- 172.21.15.67:0/2742856794 >> 172.21.15.67:0/2742856794 conn(0x7f24b806db70 msgr2=0x7f24b806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 -- 172.21.15.67:0/2742856794 shutdown_connections 2023-10-14T11:24:08.842 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.831+0000 7f24c075e700 1 -- 172.21.15.67:0/2742856794 wait complete. 2023-10-14T11:24:08.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.832+0000 7f24c075e700 1 Processor -- start 2023-10-14T11:24:08.845 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.832+0000 7f24c075e700 1 -- start start 2023-10-14T11:24:08.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b806af20 0x7f24b80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b815d8d0 0x7f24b81f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 0x7f24b80b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.846 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80ca240 con 0x7f24b80ac800 2023-10-14T11:24:08.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b814fdc0 con 0x7f24b806af20 2023-10-14T11:24:08.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24c075e700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b815ee60 con 0x7f24b815d8d0 2023-10-14T11:24:08.847 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 0x7f24b80b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 0x7f24b80b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43524/0 (socket says 172.21.15.67:43524) 2023-10-14T11:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 -- 172.21.15.67:0/2740121771 learned_addr learned my addr 172.21.15.67:0/2740121771 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b815d8d0 0x7f24b81f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.848 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24be4fa700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b806af20 0x7f24b80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 -- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b815d8d0 msgr2=0x7f24b81f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b815d8d0 0x7f24b81f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.849 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 -- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b806af20 msgr2=0x7f24b80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b806af20 0x7f24b80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.833+0000 7f24becfb700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40094a0 con 0x7f24b80ac800 2023-10-14T11:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24be4fa700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b806af20 0x7f24b80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:08.850 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f24b815d8d0 0x7f24b81f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24becfb700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 0x7f24b80b3400 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f24b000efc0 tx=0x7f24b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0009bd0 con 0x7f24b80ac800 2023-10-14T11:24:08.851 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000f040 con 0x7f24b80ac800 2023-10-14T11:24:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0003e80 con 0x7f24b80ac800 2023-10-14T11:24:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b815f140 con 0x7f24b80ac800 2023-10-14T11:24:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.834+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b815f700 con 0x7f24b80ac800 2023-10-14T11:24:08.852 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.835+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24b80728a0 con 0x7f24b80ac800 2023-10-14T11:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.835+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24b000c930 con 0x7f24b80ac800 2023-10-14T11:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24aeffd700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f249c06af00 0x7f249c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.853 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f24b008a820 con 0x7f24b80ac800 2023-10-14T11:24:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24aeffd700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7f249c073100 0x7f249c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f249c075c10 con 0x7f249c073100 2023-10-14T11:24:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24b008ac70 con 0x7f24b80ac800 2023-10-14T11:24:08.854 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24be4fa700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f249c06af00 0x7f249c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7f249c073100 0x7f249c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.836+0000 7f24bdcf9700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7f249c073100 0x7f249c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.855 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.837+0000 7f24be4fa700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f249c06af00 0x7f249c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007fd0 tx=0x7f24a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:08.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.837+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== osd.6 v2:172.21.15.72:6812/1411932619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f249c075c10 con 0x7f249c073100 2023-10-14T11:24:08.856 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.852+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 --> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24b80725c0 con 0x7f249c073100 2023-10-14T11:24:08.857 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24aeffd700 1 -- 172.21.15.67:0/2740121771 <== osd.6 v2:172.21.15.72:6812/1411932619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f24b4011b00 con 0x7f249c073100 2023-10-14T11:24:08.857 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:08.857 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:08.858 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7f249c073100 msgr2=0x7f249c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6812/1411932619,v1:172.21.15.72:6814/1411932619] conn(0x7f249c073100 0x7f249c075540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f249c06af00 msgr2=0x7f249c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.859 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f249c06af00 0x7f249c06d3c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007fd0 tx=0x7f24a8009040 comp rx=0 tx=0).stop 2023-10-14T11:24:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 msgr2=0x7f24b80b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 --2- 172.21.15.67:0/2740121771 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f24b80ac800 0x7f24b80b3400 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f24b000efc0 tx=0x7f24b000c3a0 comp rx=0 tx=0).stop 2023-10-14T11:24:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24becfb700 1 -- 172.21.15.67:0/2740121771 reap_dead start 2023-10-14T11:24:08.860 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 shutdown_connections 2023-10-14T11:24:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 >> 172.21.15.67:0/2740121771 conn(0x7f24b806db70 msgr2=0x7f24b806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 shutdown_connections 2023-10-14T11:24:08.861 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.853+0000 7f24c075e700 1 -- 172.21.15.67:0/2740121771 wait complete. 2023-10-14T11:24:08.868 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T11:24:08.993 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.990+0000 7fb419626700 1 Processor -- start 2023-10-14T11:24:08.994 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 -- start start 2023-10-14T11:24:08.996 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4141610f0 0x7fb4141617d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb414161d10 0x7fb414162190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140ce360 con 0x7fb4140ce840 2023-10-14T11:24:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140d00c0 con 0x7fb414161d10 2023-10-14T11:24:08.997 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb419626700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140d03a0 con 0x7fb4141610f0 2023-10-14T11:24:08.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb4137fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fb4140ce840 0x7fb4140cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42826/0 (socket says 172.21.15.67:42826) 2023-10-14T11:24:08.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.991+0000 7fb4137fe700 1 -- 172.21.15.67:0/2876310871 learned_addr learned my addr 172.21.15.67:0/2876310871 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:08.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb412ffd700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4141610f0 0x7fb4141617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.998 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 --2- 172.21.15.67:0/2876310871 >> v2:172.21.15.72:3300/0 conn(0x7fb414161d10 0x7fb414162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb411ffb700 1 -- 172.21.15.67:0/2876310871 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042124090 0 0) 0x7fb4140ce360 con 0x7fb4140ce840 2023-10-14T11:24:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb411ffb700 1 -- 172.21.15.67:0/2876310871 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3fc0035b0 con 0x7fb4140ce840 2023-10-14T11:24:08.999 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 -- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4141610f0 msgr2=0x7fb4141617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4141610f0 0x7fb4141617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 -- 172.21.15.67:0/2876310871 >> v1:172.21.15.67:6789/0 conn(0x7fb4140ce840 legacy=0x7fb4140cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 -- 172.21.15.67:0/2876310871 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140d0680 con 0x7fb414161d10 2023-10-14T11:24:09.000 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb4127fc700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414161d10 0x7fb414162190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb404009840 tx=0x7fb404009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a488d1ef12fcb20c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb411ffb700 1 -- 172.21.15.67:0/2876310871 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404011830 con 0x7fb414161d10 2023-10-14T11:24:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb411ffb700 1 -- 172.21.15.67:0/2876310871 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404011990 con 0x7fb414161d10 2023-10-14T11:24:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.992+0000 7fb411ffb700 1 -- 172.21.15.67:0/2876310871 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404011d20 con 0x7fb414161d10 2023-10-14T11:24:09.001 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 -- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414161d10 msgr2=0x7fb414162190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414161d10 0x7fb414162190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb404009840 tx=0x7fb404009b50 comp rx=0 tx=0).stop 2023-10-14T11:24:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 -- 172.21.15.67:0/2876310871 shutdown_connections 2023-10-14T11:24:09.002 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4141610f0 0x7fb4141617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 --2- 172.21.15.67:0/2876310871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb414161d10 0x7fb414162190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 -- 172.21.15.67:0/2876310871 >> 172.21.15.67:0/2876310871 conn(0x7fb41409cab0 msgr2=0x7fb4140d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 -- 172.21.15.67:0/2876310871 shutdown_connections 2023-10-14T11:24:09.003 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.993+0000 7fb419626700 1 -- 172.21.15.67:0/2876310871 wait complete. 2023-10-14T11:24:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.994+0000 7fb419626700 1 Processor -- start 2023-10-14T11:24:09.006 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.994+0000 7fb419626700 1 -- start start 2023-10-14T11:24:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4140ce840 0x7fb414149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4141610f0 0x7fb4140b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.007 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140cbaa0 con 0x7fb414161d10 2023-10-14T11:24:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140b81b0 con 0x7fb4141610f0 2023-10-14T11:24:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb419626700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140b8490 con 0x7fb4140ce840 2023-10-14T11:24:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.008 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43538/0 (socket says 172.21.15.67:43538) 2023-10-14T11:24:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 -- 172.21.15.67:0/1796492795 learned_addr learned my addr 172.21.15.67:0/1796492795 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4127fc700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4141610f0 0x7fb4140b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.009 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb412ffd700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4140ce840 0x7fb414149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 -- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4140ce840 msgr2=0x7fb414149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4140ce840 0x7fb414149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 -- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4141610f0 msgr2=0x7fb4140b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.010 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4141610f0 0x7fb4140b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.995+0000 7fb4137fe700 1 -- 172.21.15.67:0/1796492795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040094a0 con 0x7fb414161d10 2023-10-14T11:24:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb4137fe700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00caa0 tx=0x7fb40c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.011 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00aa80 con 0x7fb414161d10 2023-10-14T11:24:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c00abe0 con 0x7fb414161d10 2023-10-14T11:24:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c012400 con 0x7fb414161d10 2023-10-14T11:24:09.012 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4140b8770 con 0x7fb414161d10 2023-10-14T11:24:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.996+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4140b7df0 con 0x7fb414161d10 2023-10-14T11:24:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.997+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4140cb870 con 0x7fb414161d10 2023-10-14T11:24:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.997+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb40c01b3b0 con 0x7fb414161d10 2023-10-14T11:24:09.013 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.998+0000 7fb3fb7fe700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 0x7fb40006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.998+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fb40c089350 con 0x7fb414161d10 2023-10-14T11:24:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.998+0000 7fb412ffd700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 0x7fb40006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.014 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:08.998+0000 7fb412ffd700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 0x7fb40006d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb408009ab0 tx=0x7fb408008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.015 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.002+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb4140cb870 con 0x7fb414161d10 2023-10-14T11:24:09.206 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.203+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4141614d0 con 0x7fb40006af00 2023-10-14T11:24:09.207 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.204+0000 7fb3fb7fe700 1 -- 172.21.15.67:0/1796492795 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb408005a20 con 0x7fb40006af00 2023-10-14T11:24:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 msgr2=0x7fb40006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.209 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 0x7fb40006d3c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb408009ab0 tx=0x7fb408008040 comp rx=0 tx=0).stop 2023-10-14T11:24:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 msgr2=0x7fb4140b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00caa0 tx=0x7fb40c00ce60 comp rx=0 tx=0).stop 2023-10-14T11:24:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 shutdown_connections 2023-10-14T11:24:09.210 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fb40006af00 0x7fb40006d3c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fb414161d10 0x7fb4140b4e90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fb4140ce840 0x7fb414149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.211 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 --2- 172.21.15.67:0/1796492795 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4141610f0 0x7fb4140b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 >> 172.21.15.67:0/1796492795 conn(0x7fb41409cab0 msgr2=0x7fb41406cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 shutdown_connections 2023-10-14T11:24:09.212 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.206+0000 7fb419626700 1 -- 172.21.15.67:0/1796492795 wait complete. 2023-10-14T11:24:09.213 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T11:24:09.221 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T11:24:09.221 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T11:24:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.347+0000 7f20b078f700 1 Processor -- start 2023-10-14T11:24:09.350 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.347+0000 7f20b078f700 1 -- start start 2023-10-14T11:24:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20b078f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 0x7f20a80b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20b078f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20a80b71c0 0x7f20a80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.353 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20b078f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a80d03d0 con 0x7f20a80d0d50 2023-10-14T11:24:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20b078f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a8160200 con 0x7f20a80b71c0 2023-10-14T11:24:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20b078f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a815f580 con 0x7f20a815b910 2023-10-14T11:24:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20a80b71c0 0x7f20a80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.354 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20ae52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 0x7f20a80b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f20a80b71c0 0x7f20a80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.67:43950/0 (socket says 172.21.15.67:43950) 2023-10-14T11:24:09.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 -- 172.21.15.67:0/3298523705 learned_addr learned my addr 172.21.15.67:0/3298523705 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.355 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20aed2c700 1 --1- 172.21.15.67:0/3298523705 >> v1:172.21.15.72:6789/0 conn(0x7f20a80d0d50 0x7f20a80705e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.67:49662/0 (socket says 172.21.15.67:49662) 2023-10-14T11:24:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 -- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 msgr2=0x7f20a80b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 0x7f20a80b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 -- 172.21.15.67:0/3298523705 >> v1:172.21.15.72:6789/0 conn(0x7f20a80d0d50 legacy=0x7f20a80705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.356 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20add2a700 1 -- 172.21.15.67:0/3298523705 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a815f860 con 0x7f20a80b71c0 2023-10-14T11:24:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20ad529700 1 -- 172.21.15.67:0/3298523705 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967619514 0 0) 0x7f20a80d03d0 con 0x7f20a80d0d50 2023-10-14T11:24:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.348+0000 7f20ae52b700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 0x7f20a80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:24:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20add2a700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80b71c0 0x7f20a80b34c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20980098f0 tx=0x7f2098009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b4eb067290558ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20ad529700 1 -- 172.21.15.67:0/3298523705 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011830 con 0x7f20a80b71c0 2023-10-14T11:24:09.357 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20ad529700 1 -- 172.21.15.67:0/3298523705 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098011990 con 0x7f20a80b71c0 2023-10-14T11:24:09.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20ad529700 1 -- 172.21.15.67:0/3298523705 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098011d20 con 0x7f20a80b71c0 2023-10-14T11:24:09.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 -- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80b71c0 msgr2=0x7f20a80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.358 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80b71c0 0x7f20a80b34c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20980098f0 tx=0x7f2098009c00 comp rx=0 tx=0).stop 2023-10-14T11:24:09.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 -- 172.21.15.67:0/3298523705 shutdown_connections 2023-10-14T11:24:09.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a815b910 0x7f20a80b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.359 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 --2- 172.21.15.67:0/3298523705 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80b71c0 0x7f20a80b34c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 -- 172.21.15.67:0/3298523705 >> 172.21.15.67:0/3298523705 conn(0x7f20a80cdf80 msgr2=0x7f20a80ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.349+0000 7f20b078f700 1 -- 172.21.15.67:0/3298523705 shutdown_connections 2023-10-14T11:24:09.360 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.350+0000 7f20b078f700 1 -- 172.21.15.67:0/3298523705 wait complete. 2023-10-14T11:24:09.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 Processor -- start 2023-10-14T11:24:09.363 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 -- start start 2023-10-14T11:24:09.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a80b71c0 0x7f20a806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80d0d50 0x7f20a806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.364 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a815b910 0x7f20a81587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a806c020 con 0x7f20a815b910 2023-10-14T11:24:09.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8158fe0 con 0x7f20a80d0d50 2023-10-14T11:24:09.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.351+0000 7f20b078f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a806d930 con 0x7f20a80b71c0 2023-10-14T11:24:09.365 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20ae52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a80b71c0 0x7f20a806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20aed2c700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a815b910 0x7f20a81587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80d0d50 0x7f20a806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20ae52b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a80b71c0 0x7f20a806b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3301/0 says I am v2:172.21.15.67:45820/0 (socket says 172.21.15.67:45820) 2023-10-14T11:24:09.366 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20ae52b700 1 -- 172.21.15.67:0/1181974800 learned_addr learned my addr 172.21.15.67:0/1181974800 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 -- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a80b71c0 msgr2=0x7f20a806b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f20a80b71c0 0x7f20a806b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.367 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 -- 172.21.15.67:0/1181974800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a815b910 msgr2=0x7f20a81587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a815b910 0x7f20a81587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40094a0 con 0x7f20a80d0d50 2023-10-14T11:24:09.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20aed2c700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f20a815b910 0x7f20a81587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T11:24:09.368 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20add2a700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80d0d50 0x7f20a806d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20a80744a0 tx=0x7f2098004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098004510 con 0x7f20a80d0d50 2023-10-14T11:24:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209801e070 con 0x7f20a80d0d50 2023-10-14T11:24:09.369 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2098009550 con 0x7f20a80d0d50 2023-10-14T11:24:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980038e0 con 0x7f20a80d0d50 2023-10-14T11:24:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.352+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a81f2d90 con 0x7f20a80d0d50 2023-10-14T11:24:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.353+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20a815fe20 con 0x7f20a80d0d50 2023-10-14T11:24:09.370 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.354+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2098003a40 con 0x7f20a80d0d50 2023-10-14T11:24:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.354+0000 7f209effd700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f208c06af00 0x7f208c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.354+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f209808aea0 con 0x7f20a80d0d50 2023-10-14T11:24:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f20ae52b700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f208c06af00 0x7f208c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.371 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f209effd700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7f208c073100 0x7f208c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f208c075c10 con 0x7f208c073100 2023-10-14T11:24:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== mon.1 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f209808b2f0 con 0x7f20a80d0d50 2023-10-14T11:24:09.372 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f20aed2c700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7f208c073100 0x7f208c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f20ae52b700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f208c06af00 0x7f208c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009e70 tx=0x7f20a4009210 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.355+0000 7f20aed2c700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7f208c073100 0x7f208c075540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.356+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== osd.7 v2:172.21.15.72:6808/4108692876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f208c075c10 con 0x7f208c073100 2023-10-14T11:24:09.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.371+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 --> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f20a815fb40 con 0x7f208c073100 2023-10-14T11:24:09.374 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.371+0000 7f209effd700 1 -- 172.21.15.67:0/1181974800 <== osd.7 v2:172.21.15.72:6808/4108692876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f20a0007560 con 0x7f208c073100 2023-10-14T11:24:09.375 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2023-10-14T11:24:09.375 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T11:24:09.376 INFO:teuthology.orchestra.run.smithi067.stdout:} 2023-10-14T11:24:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7f208c073100 msgr2=0x7f208c075540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6808/4108692876,v1:172.21.15.72:6809/4108692876] conn(0x7f208c073100 0x7f208c075540 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f208c06af00 msgr2=0x7f208c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f208c06af00 0x7f208c06d3c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f20a4009e70 tx=0x7f20a4009210 comp rx=0 tx=0).stop 2023-10-14T11:24:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80d0d50 msgr2=0x7f20a806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 --2- 172.21.15.67:0/1181974800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f20a80d0d50 0x7f20a806d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20a80744a0 tx=0x7f2098004750 comp rx=0 tx=0).stop 2023-10-14T11:24:09.379 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20aed2c700 1 -- 172.21.15.67:0/1181974800 reap_dead start 2023-10-14T11:24:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 shutdown_connections 2023-10-14T11:24:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 >> 172.21.15.67:0/1181974800 conn(0x7f20a80cdf80 msgr2=0x7f20a815a690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 shutdown_connections 2023-10-14T11:24:09.380 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.372+0000 7f20b078f700 1 -- 172.21.15.67:0/1181974800 wait complete. 2023-10-14T11:24:09.386 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T11:24:09.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.510+0000 7f417095b700 1 Processor -- start 2023-10-14T11:24:09.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.510+0000 7f417095b700 1 -- start start 2023-10-14T11:24:09.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.510+0000 7f417095b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c15def0 0x7f416c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.510+0000 7f417095b700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416c161fe0 0x7f416c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f417095b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416c06cdd0 con 0x7f416c0cfe80 2023-10-14T11:24:09.516 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f417095b700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416c06c1c0 con 0x7f416c161fe0 2023-10-14T11:24:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f417095b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c06c4a0 con 0x7f416c15def0 2023-10-14T11:24:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416c161fe0 0x7f416c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f416c161fe0 0x7f416c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43562/0 (socket says 172.21.15.67:43562) 2023-10-14T11:24:09.517 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 -- 172.21.15.67:0/213812827 learned_addr learned my addr 172.21.15.67:0/213812827 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 -- 172.21.15.67:0/213812827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c15def0 msgr2=0x7f416c06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 --2- 172.21.15.67:0/213812827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c15def0 0x7f416c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 -- 172.21.15.67:0/213812827 >> v1:172.21.15.72:6789/0 conn(0x7f416c0cfe80 legacy=0x7f416c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.518 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 -- 172.21.15.67:0/213812827 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c06c780 con 0x7f416c161fe0 2023-10-14T11:24:09.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416ad9d700 1 --2- 172.21.15.67:0/213812827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0d0300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4164009e50 tx=0x7f416400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e689fa833f17317a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416959a700 1 -- 172.21.15.67:0/213812827 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400e070 con 0x7f416c161fe0 2023-10-14T11:24:09.519 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416959a700 1 -- 172.21.15.67:0/213812827 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164003a20 con 0x7f416c161fe0 2023-10-14T11:24:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.511+0000 7f416959a700 1 -- 172.21.15.67:0/213812827 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164003dd0 con 0x7f416c161fe0 2023-10-14T11:24:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 -- 172.21.15.67:0/213812827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 msgr2=0x7f416c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 --2- 172.21.15.67:0/213812827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0d0300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4164009e50 tx=0x7f416400b330 comp rx=0 tx=0).stop 2023-10-14T11:24:09.520 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 -- 172.21.15.67:0/213812827 shutdown_connections 2023-10-14T11:24:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 --2- 172.21.15.67:0/213812827 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0d0300 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 --2- 172.21.15.67:0/213812827 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c15def0 0x7f416c06d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 -- 172.21.15.67:0/213812827 >> 172.21.15.67:0/213812827 conn(0x7f416c0d1570 msgr2=0x7f416c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.521 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 -- 172.21.15.67:0/213812827 shutdown_connections 2023-10-14T11:24:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.512+0000 7f417095b700 1 -- 172.21.15.67:0/213812827 wait complete. 2023-10-14T11:24:09.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 Processor -- start 2023-10-14T11:24:09.524 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 -- start start 2023-10-14T11:24:09.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c0cfe80 0x7f416c0b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f416c15def0 0x7f416c06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.525 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c1f2fb0 con 0x7f416c161fe0 2023-10-14T11:24:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416c0b3880 con 0x7f416c15def0 2023-10-14T11:24:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.514+0000 7f417095b700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416c1f31f0 con 0x7f416c0cfe80 2023-10-14T11:24:09.526 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43568/0 (socket says 172.21.15.67:43568) 2023-10-14T11:24:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 -- 172.21.15.67:0/4117806672 learned_addr learned my addr 172.21.15.67:0/4117806672 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416a59c700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c0cfe80 0x7f416c0b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.527 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f4169d9b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f416c15def0 0x7f416c06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 -- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c0cfe80 msgr2=0x7f416c0b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c0cfe80 0x7f416c0b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.528 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 -- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f416c15def0 msgr2=0x7f416c06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f416c15def0 0x7f416c06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 -- 172.21.15.67:0/4117806672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4164009b30 con 0x7f416c161fe0 2023-10-14T11:24:09.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f416ad9d700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f416c072380 tx=0x7f4164004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.529 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164004440 con 0x7f416c161fe0 2023-10-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41640045a0 con 0x7f416c161fe0 2023-10-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416c1f34d0 con 0x7f416c161fe0 2023-10-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164004930 con 0x7f416c161fe0 2023-10-14T11:24:09.530 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.515+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416c1f3a90 con 0x7f416c161fe0 2023-10-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.516+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f416c06ca40 con 0x7f416c161fe0 2023-10-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.517+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4164012430 con 0x7f416c161fe0 2023-10-14T11:24:09.531 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.517+0000 7f4162ffd700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 0x7f414c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.517+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f416408ad40 con 0x7f416c161fe0 2023-10-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.517+0000 7f416a59c700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 0x7f414c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.532 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.518+0000 7f416a59c700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 0x7f414c06d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f415c009a10 tx=0x7f415c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.533 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.522+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f416c06ca40 con 0x7f416c161fe0 2023-10-14T11:24:09.723 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.720+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f416c15f6d0 con 0x7f414c06af00 2023-10-14T11:24:09.724 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.722+0000 7f4162ffd700 1 -- 172.21.15.67:0/4117806672 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f415c009660 con 0x7f414c06af00 2023-10-14T11:24:09.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 msgr2=0x7f414c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.726 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 0x7f414c06d3c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f415c009a10 tx=0x7f415c009190 comp rx=0 tx=0).stop 2023-10-14T11:24:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 msgr2=0x7f416c0700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f416c072380 tx=0x7f4164004ad0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.727 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 shutdown_connections 2023-10-14T11:24:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f414c06af00 0x7f414c06d3c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f416c161fe0 0x7f416c0700c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f416c0cfe80 0x7f416c0b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.728 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 --2- 172.21.15.67:0/4117806672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f416c15def0 0x7f416c06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 >> 172.21.15.67:0/4117806672 conn(0x7f416c0d1570 msgr2=0x7f416c0ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 shutdown_connections 2023-10-14T11:24:09.729 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.723+0000 7f417095b700 1 -- 172.21.15.67:0/4117806672 wait complete. 2023-10-14T11:24:09.730 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T11:24:09.738 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:09.864 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.861+0000 7effa872f700 1 Processor -- start 2023-10-14T11:24:09.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.861+0000 7effa872f700 1 -- start start 2023-10-14T11:24:09.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa872f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7effa00c52c0 0x7effa00c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa872f700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00cfa80 con 0x7effa015e0c0 2023-10-14T11:24:09.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa872f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00cfd60 con 0x7effa015e4a0 2023-10-14T11:24:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa872f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00d0040 con 0x7effa00c52c0 2023-10-14T11:24:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa64cb700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7effa015e0c0 0x7effa0072580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42866/0 (socket says 172.21.15.67:42866) 2023-10-14T11:24:09.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa64cb700 1 -- 172.21.15.67:0/3785979151 learned_addr learned my addr 172.21.15.67:0/3785979151 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa6ccc700 1 --2- 172.21.15.67:0/3785979151 >> v2:172.21.15.72:3300/0 conn(0x7effa00c52c0 0x7effa00c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619697339 0 0) 0x7effa00cfa80 con 0x7effa015e0c0 2023-10-14T11:24:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8c0035b0 con 0x7effa015e0c0 2023-10-14T11:24:09.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v1:172.21.15.67:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226929238 0 0) 0x7eff8c0035b0 con 0x7effa015e0c0 2023-10-14T11:24:09.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 >> v2:172.21.15.72:3300/0 conn(0x7effa00c52c0 msgr2=0x7effa00c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 --2- 172.21.15.67:0/3785979151 >> v2:172.21.15.72:3300/0 conn(0x7effa00c52c0 0x7effa00c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 >> v1:172.21.15.72:6789/0 conn(0x7effa015e4a0 legacy=0x7effa00cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 --> v1:172.21.15.67:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa006f570 con 0x7effa015e0c0 2023-10-14T11:24:09.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v1:172.21.15.67:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 910756387 0 0) 0x7eff90001670 con 0x7effa015e0c0 2023-10-14T11:24:09.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 >> v1:172.21.15.67:6789/0 conn(0x7effa015e0c0 legacy=0x7effa0072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7eff8c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c004850 0x7eff8c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff8c005210 0x7eff8c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00d0040 con 0x7eff8c003a00 2023-10-14T11:24:09.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c00c1b0 con 0x7eff8c004850 2023-10-14T11:24:09.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.863+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c00c370 con 0x7eff8c005210 2023-10-14T11:24:09.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7eff8c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa5cca700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c004850 0x7eff8c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.876 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa6ccc700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff8c005210 0x7eff8c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.876 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 -- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff8c005210 msgr2=0x7eff8c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.876 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7eff8c005210 0x7eff8c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.876 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 -- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c004850 msgr2=0x7eff8c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c004850 0x7eff8c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 -- 172.21.15.67:0/3785979151 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0035b0 con 0x7eff8c003a00 2023-10-14T11:24:09.877 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa6ccc700 1 -- 172.21.15.67:0/3785979151 reap_dead start 2023-10-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa64cb700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7eff8c003e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c240 tx=0x7eff8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867092cb77aae6c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90007c10 con 0x7eff8c003a00 2023-10-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9000cd60 con 0x7eff8c003a00 2023-10-14T11:24:09.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.864+0000 7effa54c9700 1 -- 172.21.15.67:0/3785979151 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90005ba0 con 0x7eff8c003a00 2023-10-14T11:24:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 -- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 msgr2=0x7eff8c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7eff8c003e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c240 tx=0x7eff8c005880 comp rx=0 tx=0).stop 2023-10-14T11:24:09.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 -- 172.21.15.67:0/3785979151 shutdown_connections 2023-10-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 --2- 172.21.15.67:0/3785979151 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7eff8c003e20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 -- 172.21.15.67:0/3785979151 >> 172.21.15.67:0/3785979151 conn(0x7effa00d0440 msgr2=0x7effa00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 -- 172.21.15.67:0/3785979151 shutdown_connections 2023-10-14T11:24:09.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.865+0000 7effa872f700 1 -- 172.21.15.67:0/3785979151 wait complete. 2023-10-14T11:24:09.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.866+0000 7effa872f700 1 Processor -- start 2023-10-14T11:24:09.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 -- start start 2023-10-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7effa00b3fe0 0x7effa015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0153c90 0x7effa0154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b5160 con 0x7eff8c003a00 2023-10-14T11:24:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00c9150 con 0x7effa0153c90 2023-10-14T11:24:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.867+0000 7effa872f700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa0154660 con 0x7effa00b3fe0 2023-10-14T11:24:09.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43584/0 (socket says 172.21.15.67:43584) 2023-10-14T11:24:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 -- 172.21.15.67:0/3552075541 learned_addr learned my addr 172.21.15.67:0/3552075541 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa5cca700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7effa00b3fe0 0x7effa015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa6ccc700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0153c90 0x7effa0154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 -- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7effa00b3fe0 msgr2=0x7effa015d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7effa00b3fe0 0x7effa015d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 -- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0153c90 msgr2=0x7effa0154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:09.887 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0153c90 0x7effa0154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:09.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 -- 172.21.15.67:0/3552075541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa015eab0 con 0x7eff8c003a00 2023-10-14T11:24:09.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa64cb700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c180 tx=0x7eff90001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.888 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90000ed0 con 0x7eff8c003a00 2023-10-14T11:24:09.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900070d0 con 0x7eff8c003a00 2023-10-14T11:24:09.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa00b44e0 con 0x7eff8c003a00 2023-10-14T11:24:09.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90007480 con 0x7eff8c003a00 2023-10-14T11:24:09.889 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.868+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00b4aa0 con 0x7eff8c003a00 2023-10-14T11:24:09.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.869+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa00cdcc0 con 0x7eff8c003a00 2023-10-14T11:24:09.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.870+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7eff900075e0 con 0x7eff8c003a00 2023-10-14T11:24:09.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.870+0000 7eff96ffd700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 0x7eff8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:09.890 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.870+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7eff9008a6f0 con 0x7eff8c003a00 2023-10-14T11:24:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.870+0000 7effa5cca700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 0x7eff8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.871+0000 7effa5cca700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 0x7eff8406d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7effa006b8b0 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:09.891 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:09.875+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff90055810 con 0x7eff8c003a00 2023-10-14T11:24:10.074 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.071+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7effa014e5f0 con 0x7eff8406af00 2023-10-14T11:24:10.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.080+0000 7eff96ffd700 1 -- 172.21.15.67:0/3552075541 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288716 (secure 0 0 0) 0x7effa014e5f0 con 0x7eff8406af00 2023-10-14T11:24:10.086 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 msgr2=0x7eff8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 0x7eff8406d3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7effa006b8b0 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2023-10-14T11:24:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 msgr2=0x7effa014e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:10.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00c180 tx=0x7eff90001a00 comp rx=0 tx=0).stop 2023-10-14T11:24:10.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 shutdown_connections 2023-10-14T11:24:10.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effa0153c90 0x7effa0154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:10.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7eff8406af00 0x7eff8406d3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:10.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7eff8c003a00 0x7effa014e0b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:10.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 --2- 172.21.15.67:0/3552075541 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7effa00b3fe0 0x7effa015d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:10.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 >> 172.21.15.67:0/3552075541 conn(0x7effa00d0440 msgr2=0x7effa006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:10.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 shutdown_connections 2023-10-14T11:24:10.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:10.083+0000 7effa872f700 1 -- 172.21.15.67:0/3552075541 wait complete. 2023-10-14T11:24:10.094 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:10.098 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-14T11:24:08.418189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220200,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754520,"statfs":{"total":773094113280,"available":772868628480,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002657"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852078+0000","last_change":"2023-10-14T11:23:54.854224+0000","last_active":"2023-10-14T11:23:55.852078+0000","last_peered":"2023-10-14T11:23:55.852078+0000","last_clean":"2023-10-14T11:23:55.852078+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:23:55.852078+0000","last_undegraded":"2023-10-14T11:23:55.852078+0000","last_fullsized":"2023-10-14T11:23:55.852078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:07.719507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852193+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:55.852193+0000","last_peered":"2023-10-14T11:23:55.852193+0000","last_clean":"2023-10-14T11:23:55.852193+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:55.852193+0000","last_undegraded":"2023-10-14T11:23:55.852193+0000","last_fullsized":"2023-10-14T11:23:55.852193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605436+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605436+0000","last_peered":"2023-10-14T11:23:57.605436+0000","last_clean":"2023-10-14T11:23:57.605436+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605436+0000","last_undegraded":"2023-10-14T11:23:57.605436+0000","last_fullsized":"2023-10-14T11:23:57.605436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885763+0000","last_change":"2023-10-14T11:23:54.858843+0000","last_active":"2023-10-14T11:23:55.885763+0000","last_peered":"2023-10-14T11:23:55.885763+0000","last_clean":"2023-10-14T11:23:55.885763+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:23:55.885763+0000","last_undegraded":"2023-10-14T11:23:55.885763+0000","last_fullsized":"2023-10-14T11:23:55.885763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850323+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:55.850323+0000","last_peered":"2023-10-14T11:23:55.850323+0000","last_clean":"2023-10-14T11:23:55.850323+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:55.850323+0000","last_undegraded":"2023-10-14T11:23:55.850323+0000","last_fullsized":"2023-10-14T11:23:55.850323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:13.377772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881261+0000","last_change":"2023-10-14T11:23:54.863574+0000","last_active":"2023-10-14T11:23:57.881261+0000","last_peered":"2023-10-14T11:23:57.881261+0000","last_clean":"2023-10-14T11:23:57.881261+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:23:57.881261+0000","last_undegraded":"2023-10-14T11:23:57.881261+0000","last_fullsized":"2023-10-14T11:23:57.881261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881305+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:57.881305+0000","last_peered":"2023-10-14T11:23:57.881305+0000","last_clean":"2023-10-14T11:23:57.881305+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:57.881305+0000","last_undegraded":"2023-10-14T11:23:57.881305+0000","last_fullsized":"2023-10-14T11:23:57.881305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881869+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:57.881869+0000","last_peered":"2023-10-14T11:23:57.881869+0000","last_clean":"2023-10-14T11:23:57.881869+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:57.881869+0000","last_undegraded":"2023-10-14T11:23:57.881869+0000","last_fullsized":"2023-10-14T11:23:57.881869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886030+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:55.886030+0000","last_peered":"2023-10-14T11:23:55.886030+0000","last_clean":"2023-10-14T11:23:55.886030+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:55.886030+0000","last_undegraded":"2023-10-14T11:23:55.886030+0000","last_fullsized":"2023-10-14T11:23:55.886030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:04.625424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881695+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:57.881695+0000","last_peered":"2023-10-14T11:23:57.881695+0000","last_clean":"2023-10-14T11:23:57.881695+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:57.881695+0000","last_undegraded":"2023-10-14T11:23:57.881695+0000","last_fullsized":"2023-10-14T11:23:57.881695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605355+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605355+0000","last_peered":"2023-10-14T11:23:57.605355+0000","last_clean":"2023-10-14T11:23:57.605355+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605355+0000","last_undegraded":"2023-10-14T11:23:57.605355+0000","last_fullsized":"2023-10-14T11:23:57.605355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851007+0000","last_change":"2023-10-14T11:23:54.861898+0000","last_active":"2023-10-14T11:23:55.851007+0000","last_peered":"2023-10-14T11:23:55.851007+0000","last_clean":"2023-10-14T11:23:55.851007+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:23:55.851007+0000","last_undegraded":"2023-10-14T11:23:55.851007+0000","last_fullsized":"2023-10-14T11:23:55.851007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:16.446121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851947+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:55.851947+0000","last_peered":"2023-10-14T11:23:55.851947+0000","last_clean":"2023-10-14T11:23:55.851947+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:55.851947+0000","last_undegraded":"2023-10-14T11:23:55.851947+0000","last_fullsized":"2023-10-14T11:23:55.851947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605377+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605377+0000","last_peered":"2023-10-14T11:23:57.605377+0000","last_clean":"2023-10-14T11:23:57.605377+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605377+0000","last_undegraded":"2023-10-14T11:23:57.605377+0000","last_fullsized":"2023-10-14T11:23:57.605377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:54:30.773236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881506+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:57.881506+0000","last_peered":"2023-10-14T11:23:57.881506+0000","last_clean":"2023-10-14T11:23:57.881506+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:57.881506+0000","last_undegraded":"2023-10-14T11:23:57.881506+0000","last_fullsized":"2023-10-14T11:23:57.881506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881854+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881854+0000","last_peered":"2023-10-14T11:23:57.881854+0000","last_clean":"2023-10-14T11:23:57.881854+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881854+0000","last_undegraded":"2023-10-14T11:23:57.881854+0000","last_fullsized":"2023-10-14T11:23:57.881854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852161+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:55.852161+0000","last_peered":"2023-10-14T11:23:55.852161+0000","last_clean":"2023-10-14T11:23:55.852161+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:55.852161+0000","last_undegraded":"2023-10-14T11:23:55.852161+0000","last_fullsized":"2023-10-14T11:23:55.852161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851917+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:55.851917+0000","last_peered":"2023-10-14T11:23:55.851917+0000","last_clean":"2023-10-14T11:23:55.851917+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:55.851917+0000","last_undegraded":"2023-10-14T11:23:55.851917+0000","last_fullsized":"2023-10-14T11:23:55.851917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:50:47.622707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851036+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:55.851036+0000","last_peered":"2023-10-14T11:23:55.851036+0000","last_clean":"2023-10-14T11:23:55.851036+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:55.851036+0000","last_undegraded":"2023-10-14T11:23:55.851036+0000","last_fullsized":"2023-10-14T11:23:55.851036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:36.485252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881368+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:57.881368+0000","last_peered":"2023-10-14T11:23:57.881368+0000","last_clean":"2023-10-14T11:23:57.881368+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:57.881368+0000","last_undegraded":"2023-10-14T11:23:57.881368+0000","last_fullsized":"2023-10-14T11:23:57.881368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882034+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882034+0000","last_peered":"2023-10-14T11:23:57.882034+0000","last_clean":"2023-10-14T11:23:57.882034+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882034+0000","last_undegraded":"2023-10-14T11:23:57.882034+0000","last_fullsized":"2023-10-14T11:23:57.882034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.961981+0000","last_change":"2023-10-14T11:23:54.854132+0000","last_active":"2023-10-14T11:23:56.961981+0000","last_peered":"2023-10-14T11:23:56.961981+0000","last_clean":"2023-10-14T11:23:56.961981+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:23:56.961981+0000","last_undegraded":"2023-10-14T11:23:56.961981+0000","last_fullsized":"2023-10-14T11:23:56.961981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605133+0000","last_change":"2023-10-14T11:23:54.862080+0000","last_active":"2023-10-14T11:23:57.605133+0000","last_peered":"2023-10-14T11:23:57.605133+0000","last_clean":"2023-10-14T11:23:57.605133+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:23:57.605133+0000","last_undegraded":"2023-10-14T11:23:57.605133+0000","last_fullsized":"2023-10-14T11:23:57.605133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885928+0000","last_change":"2023-10-14T11:23:54.853673+0000","last_active":"2023-10-14T11:23:55.885928+0000","last_peered":"2023-10-14T11:23:55.885928+0000","last_clean":"2023-10-14T11:23:55.885928+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:23:55.885928+0000","last_undegraded":"2023-10-14T11:23:55.885928+0000","last_fullsized":"2023-10-14T11:23:55.885928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852361+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:55.852361+0000","last_peered":"2023-10-14T11:23:55.852361+0000","last_clean":"2023-10-14T11:23:55.852361+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:55.852361+0000","last_undegraded":"2023-10-14T11:23:55.852361+0000","last_fullsized":"2023-10-14T11:23:55.852361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:22.856521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886095+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:55.886095+0000","last_peered":"2023-10-14T11:23:55.886095+0000","last_clean":"2023-10-14T11:23:55.886095+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:55.886095+0000","last_undegraded":"2023-10-14T11:23:55.886095+0000","last_fullsized":"2023-10-14T11:23:55.886095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605458+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:57.605458+0000","last_peered":"2023-10-14T11:23:57.605458+0000","last_clean":"2023-10-14T11:23:57.605458+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:57.605458+0000","last_undegraded":"2023-10-14T11:23:57.605458+0000","last_fullsized":"2023-10-14T11:23:57.605458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882087+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:57.882087+0000","last_peered":"2023-10-14T11:23:57.882087+0000","last_clean":"2023-10-14T11:23:57.882087+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:57.882087+0000","last_undegraded":"2023-10-14T11:23:57.882087+0000","last_fullsized":"2023-10-14T11:23:57.882087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:31.104112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881332+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:57.881332+0000","last_peered":"2023-10-14T11:23:57.881332+0000","last_clean":"2023-10-14T11:23:57.881332+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:57.881332+0000","last_undegraded":"2023-10-14T11:23:57.881332+0000","last_fullsized":"2023-10-14T11:23:57.881332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852015+0000","last_change":"2023-10-14T11:23:54.862506+0000","last_active":"2023-10-14T11:23:55.852015+0000","last_peered":"2023-10-14T11:23:55.852015+0000","last_clean":"2023-10-14T11:23:55.852015+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:23:55.852015+0000","last_undegraded":"2023-10-14T11:23:55.852015+0000","last_fullsized":"2023-10-14T11:23:55.852015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:07.555192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881085+0000","last_change":"2023-10-14T11:23:54.858571+0000","last_active":"2023-10-14T11:23:57.881085+0000","last_peered":"2023-10-14T11:23:57.881085+0000","last_clean":"2023-10-14T11:23:57.881085+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:23:57.881085+0000","last_undegraded":"2023-10-14T11:23:57.881085+0000","last_fullsized":"2023-10-14T11:23:57.881085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:32.710103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962234+0000","last_change":"2023-10-14T11:23:54.857116+0000","last_active":"2023-10-14T11:23:56.962234+0000","last_peered":"2023-10-14T11:23:56.962234+0000","last_clean":"2023-10-14T11:23:56.962234+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:23:56.962234+0000","last_undegraded":"2023-10-14T11:23:56.962234+0000","last_fullsized":"2023-10-14T11:23:56.962234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852140+0000","last_change":"2023-10-14T11:23:53.838937+0000","last_active":"2023-10-14T11:23:55.852140+0000","last_peered":"2023-10-14T11:23:55.852140+0000","last_clean":"2023-10-14T11:23:55.852140+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:23:55.852140+0000","last_undegraded":"2023-10-14T11:23:55.852140+0000","last_fullsized":"2023-10-14T11:23:55.852140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852120+0000","last_change":"2023-10-14T11:23:54.858515+0000","last_active":"2023-10-14T11:23:55.852120+0000","last_peered":"2023-10-14T11:23:55.852120+0000","last_clean":"2023-10-14T11:23:55.852120+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:23:55.852120+0000","last_undegraded":"2023-10-14T11:23:55.852120+0000","last_fullsized":"2023-10-14T11:23:55.852120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:50.557747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962294+0000","last_change":"2023-10-14T11:23:53.846474+0000","last_active":"2023-10-14T11:23:56.962294+0000","last_peered":"2023-10-14T11:23:56.962294+0000","last_clean":"2023-10-14T11:23:56.962294+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:23:56.962294+0000","last_undegraded":"2023-10-14T11:23:56.962294+0000","last_fullsized":"2023-10-14T11:23:56.962294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881656+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881656+0000","last_peered":"2023-10-14T11:23:57.881656+0000","last_clean":"2023-10-14T11:23:57.881656+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881656+0000","last_undegraded":"2023-10-14T11:23:57.881656+0000","last_fullsized":"2023-10-14T11:23:57.881656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:38.621767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851999+0000","last_change":"2023-10-14T11:23:53.848881+0000","last_active":"2023-10-14T11:23:55.851999+0000","last_peered":"2023-10-14T11:23:55.851999+0000","last_clean":"2023-10-14T11:23:55.851999+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:23:55.851999+0000","last_undegraded":"2023-10-14T11:23:55.851999+0000","last_fullsized":"2023-10-14T11:23:55.851999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886056+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:55.886056+0000","last_peered":"2023-10-14T11:23:55.886056+0000","last_clean":"2023-10-14T11:23:55.886056+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:55.886056+0000","last_undegraded":"2023-10-14T11:23:55.886056+0000","last_fullsized":"2023-10-14T11:23:55.886056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:46.787814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851148+0000","last_change":"2023-10-14T11:23:53.850146+0000","last_active":"2023-10-14T11:23:55.851148+0000","last_peered":"2023-10-14T11:23:55.851148+0000","last_clean":"2023-10-14T11:23:55.851148+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:23:55.851148+0000","last_undegraded":"2023-10-14T11:23:55.851148+0000","last_fullsized":"2023-10-14T11:23:55.851148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:00:05.624536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881483+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881483+0000","last_peered":"2023-10-14T11:23:57.881483+0000","last_clean":"2023-10-14T11:23:57.881483+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881483+0000","last_undegraded":"2023-10-14T11:23:57.881483+0000","last_fullsized":"2023-10-14T11:23:57.881483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466998+0000","last_change":"2023-10-14T11:23:53.842302+0000","last_active":"2023-10-14T11:23:56.466998+0000","last_peered":"2023-10-14T11:23:56.466998+0000","last_clean":"2023-10-14T11:23:56.466998+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:23:56.466998+0000","last_undegraded":"2023-10-14T11:23:56.466998+0000","last_fullsized":"2023-10-14T11:23:56.466998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:33.919216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605354+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605354+0000","last_peered":"2023-10-14T11:23:57.605354+0000","last_clean":"2023-10-14T11:23:57.605354+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605354+0000","last_undegraded":"2023-10-14T11:23:57.605354+0000","last_fullsized":"2023-10-14T11:23:57.605354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:03.133757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466904+0000","last_change":"2023-10-14T11:23:53.842032+0000","last_active":"2023-10-14T11:23:56.466904+0000","last_peered":"2023-10-14T11:23:56.466904+0000","last_clean":"2023-10-14T11:23:56.466904+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:23:56.466904+0000","last_undegraded":"2023-10-14T11:23:56.466904+0000","last_fullsized":"2023-10-14T11:23:56.466904+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881917+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:57.881917+0000","last_peered":"2023-10-14T11:23:57.881917+0000","last_clean":"2023-10-14T11:23:57.881917+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:57.881917+0000","last_undegraded":"2023-10-14T11:23:57.881917+0000","last_fullsized":"2023-10-14T11:23:57.881917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851656+0000","last_change":"2023-10-14T11:23:53.848465+0000","last_active":"2023-10-14T11:23:55.851656+0000","last_peered":"2023-10-14T11:23:55.851656+0000","last_clean":"2023-10-14T11:23:55.851656+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:23:55.851656+0000","last_undegraded":"2023-10-14T11:23:55.851656+0000","last_fullsized":"2023-10-14T11:23:55.851656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885630+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:55.885630+0000","last_peered":"2023-10-14T11:23:55.885630+0000","last_clean":"2023-10-14T11:23:55.885630+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:55.885630+0000","last_undegraded":"2023-10-14T11:23:55.885630+0000","last_fullsized":"2023-10-14T11:23:55.885630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466768+0000","last_change":"2023-10-14T11:23:53.835978+0000","last_active":"2023-10-14T11:23:56.466768+0000","last_peered":"2023-10-14T11:23:56.466768+0000","last_clean":"2023-10-14T11:23:56.466768+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:23:56.466768+0000","last_undegraded":"2023-10-14T11:23:56.466768+0000","last_fullsized":"2023-10-14T11:23:56.466768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:06:47.601359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605582+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605582+0000","last_peered":"2023-10-14T11:23:57.605582+0000","last_clean":"2023-10-14T11:23:57.605582+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605582+0000","last_undegraded":"2023-10-14T11:23:57.605582+0000","last_fullsized":"2023-10-14T11:23:57.605582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852363+0000","last_change":"2023-10-14T11:23:53.846434+0000","last_active":"2023-10-14T11:23:55.852363+0000","last_peered":"2023-10-14T11:23:55.852363+0000","last_clean":"2023-10-14T11:23:55.852363+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:23:55.852363+0000","last_undegraded":"2023-10-14T11:23:55.852363+0000","last_fullsized":"2023-10-14T11:23:55.852363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:45.783658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852439+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:55.852439+0000","last_peered":"2023-10-14T11:23:55.852439+0000","last_clean":"2023-10-14T11:23:55.852439+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:55.852439+0000","last_undegraded":"2023-10-14T11:23:55.852439+0000","last_fullsized":"2023-10-14T11:23:55.852439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:25.756897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962301+0000","last_change":"2023-10-14T11:23:53.848941+0000","last_active":"2023-10-14T11:23:56.962301+0000","last_peered":"2023-10-14T11:23:56.962301+0000","last_clean":"2023-10-14T11:23:56.962301+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:23:56.962301+0000","last_undegraded":"2023-10-14T11:23:56.962301+0000","last_fullsized":"2023-10-14T11:23:56.962301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852112+0000","last_change":"2023-10-14T11:23:54.852866+0000","last_active":"2023-10-14T11:23:55.852112+0000","last_peered":"2023-10-14T11:23:55.852112+0000","last_clean":"2023-10-14T11:23:55.852112+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:23:55.852112+0000","last_undegraded":"2023-10-14T11:23:55.852112+0000","last_fullsized":"2023-10-14T11:23:55.852112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466952+0000","last_change":"2023-10-14T11:23:53.845364+0000","last_active":"2023-10-14T11:23:56.466952+0000","last_peered":"2023-10-14T11:23:56.466952+0000","last_clean":"2023-10-14T11:23:56.466952+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:23:56.466952+0000","last_undegraded":"2023-10-14T11:23:56.466952+0000","last_fullsized":"2023-10-14T11:23:56.466952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:03.512782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605437+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605437+0000","last_peered":"2023-10-14T11:23:57.605437+0000","last_clean":"2023-10-14T11:23:57.605437+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605437+0000","last_undegraded":"2023-10-14T11:23:57.605437+0000","last_fullsized":"2023-10-14T11:23:57.605437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852077+0000","last_change":"2023-10-14T11:23:53.844686+0000","last_active":"2023-10-14T11:23:55.852077+0000","last_peered":"2023-10-14T11:23:55.852077+0000","last_clean":"2023-10-14T11:23:55.852077+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:23:55.852077+0000","last_undegraded":"2023-10-14T11:23:55.852077+0000","last_fullsized":"2023-10-14T11:23:55.852077+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:03.621268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885638+0000","last_change":"2023-10-14T11:23:54.854776+0000","last_active":"2023-10-14T11:23:55.885638+0000","last_peered":"2023-10-14T11:23:55.885638+0000","last_clean":"2023-10-14T11:23:55.885638+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:23:55.885638+0000","last_undegraded":"2023-10-14T11:23:55.885638+0000","last_fullsized":"2023-10-14T11:23:55.885638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:30.076761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466951+0000","last_change":"2023-10-14T11:23:53.836793+0000","last_active":"2023-10-14T11:23:56.466951+0000","last_peered":"2023-10-14T11:23:56.466951+0000","last_clean":"2023-10-14T11:23:56.466951+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:23:56.466951+0000","last_undegraded":"2023-10-14T11:23:56.466951+0000","last_fullsized":"2023-10-14T11:23:56.466951+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:21.261901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851932+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:55.851932+0000","last_peered":"2023-10-14T11:23:55.851932+0000","last_clean":"2023-10-14T11:23:55.851932+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:55.851932+0000","last_undegraded":"2023-10-14T11:23:55.851932+0000","last_fullsized":"2023-10-14T11:23:55.851932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:58.325600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885675+0000","last_change":"2023-10-14T11:23:53.833085+0000","last_active":"2023-10-14T11:23:55.885675+0000","last_peered":"2023-10-14T11:23:55.885675+0000","last_clean":"2023-10-14T11:23:55.885675+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:23:55.885675+0000","last_undegraded":"2023-10-14T11:23:55.885675+0000","last_fullsized":"2023-10-14T11:23:55.885675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:43:06.551037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881653+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881653+0000","last_peered":"2023-10-14T11:23:57.881653+0000","last_clean":"2023-10-14T11:23:57.881653+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881653+0000","last_undegraded":"2023-10-14T11:23:57.881653+0000","last_fullsized":"2023-10-14T11:23:57.881653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851731+0000","last_change":"2023-10-14T11:23:53.846856+0000","last_active":"2023-10-14T11:23:55.851731+0000","last_peered":"2023-10-14T11:23:55.851731+0000","last_clean":"2023-10-14T11:23:55.851731+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:23:55.851731+0000","last_undegraded":"2023-10-14T11:23:55.851731+0000","last_fullsized":"2023-10-14T11:23:55.851731+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852039+0000","last_change":"2023-10-14T11:23:54.859640+0000","last_active":"2023-10-14T11:23:55.852039+0000","last_peered":"2023-10-14T11:23:55.852039+0000","last_clean":"2023-10-14T11:23:55.852039+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:23:55.852039+0000","last_undegraded":"2023-10-14T11:23:55.852039+0000","last_fullsized":"2023-10-14T11:23:55.852039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:28.896536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851659+0000","last_change":"2023-10-14T11:23:53.842900+0000","last_active":"2023-10-14T11:23:55.851659+0000","last_peered":"2023-10-14T11:23:55.851659+0000","last_clean":"2023-10-14T11:23:55.851659+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:23:55.851659+0000","last_undegraded":"2023-10-14T11:23:55.851659+0000","last_fullsized":"2023-10-14T11:23:55.851659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:43:29.072605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881694+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:57.881694+0000","last_peered":"2023-10-14T11:23:57.881694+0000","last_clean":"2023-10-14T11:23:57.881694+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:57.881694+0000","last_undegraded":"2023-10-14T11:23:57.881694+0000","last_fullsized":"2023-10-14T11:23:57.881694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:47.369818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886046+0000","last_change":"2023-10-14T11:23:53.838625+0000","last_active":"2023-10-14T11:23:55.886046+0000","last_peered":"2023-10-14T11:23:55.886046+0000","last_clean":"2023-10-14T11:23:55.886046+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:23:55.886046+0000","last_undegraded":"2023-10-14T11:23:55.886046+0000","last_fullsized":"2023-10-14T11:23:55.886046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605690+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605690+0000","last_peered":"2023-10-14T11:23:57.605690+0000","last_clean":"2023-10-14T11:23:57.605690+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605690+0000","last_undegraded":"2023-10-14T11:23:57.605690+0000","last_fullsized":"2023-10-14T11:23:57.605690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:18.592318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467101+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:56.467101+0000","last_peered":"2023-10-14T11:23:56.467101+0000","last_clean":"2023-10-14T11:23:56.467101+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:56.467101+0000","last_undegraded":"2023-10-14T11:23:56.467101+0000","last_fullsized":"2023-10-14T11:23:56.467101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:52:12.373616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.886028+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:55.886028+0000","last_peered":"2023-10-14T11:23:55.886028+0000","last_clean":"2023-10-14T11:23:55.886028+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:55.886028+0000","last_undegraded":"2023-10-14T11:23:55.886028+0000","last_fullsized":"2023-10-14T11:23:55.886028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:54:04.516938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467061+0000","last_change":"2023-10-14T11:23:53.850506+0000","last_active":"2023-10-14T11:23:56.467061+0000","last_peered":"2023-10-14T11:23:56.467061+0000","last_clean":"2023-10-14T11:23:56.467061+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:23:56.467061+0000","last_undegraded":"2023-10-14T11:23:56.467061+0000","last_fullsized":"2023-10-14T11:23:56.467061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851202+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:55.851202+0000","last_peered":"2023-10-14T11:23:55.851202+0000","last_clean":"2023-10-14T11:23:55.851202+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:55.851202+0000","last_undegraded":"2023-10-14T11:23:55.851202+0000","last_fullsized":"2023-10-14T11:23:55.851202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:22.420733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467037+0000","last_change":"2023-10-14T11:23:53.849957+0000","last_active":"2023-10-14T11:23:56.467037+0000","last_peered":"2023-10-14T11:23:56.467037+0000","last_clean":"2023-10-14T11:23:56.467037+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:23:56.467037+0000","last_undegraded":"2023-10-14T11:23:56.467037+0000","last_fullsized":"2023-10-14T11:23:56.467037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850374+0000","last_change":"2023-10-14T11:23:54.861183+0000","last_active":"2023-10-14T11:23:55.850374+0000","last_peered":"2023-10-14T11:23:55.850374+0000","last_clean":"2023-10-14T11:23:55.850374+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:23:55.850374+0000","last_undegraded":"2023-10-14T11:23:55.850374+0000","last_fullsized":"2023-10-14T11:23:55.850374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:38:57.770760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962181+0000","last_change":"2023-10-14T11:23:53.843402+0000","last_active":"2023-10-14T11:23:56.962181+0000","last_peered":"2023-10-14T11:23:56.962181+0000","last_clean":"2023-10-14T11:23:56.962181+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:23:56.962181+0000","last_undegraded":"2023-10-14T11:23:56.962181+0000","last_fullsized":"2023-10-14T11:23:56.962181+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851000+0000","last_change":"2023-10-14T11:23:54.862078+0000","last_active":"2023-10-14T11:23:55.851000+0000","last_peered":"2023-10-14T11:23:55.851000+0000","last_clean":"2023-10-14T11:23:55.851000+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:23:55.851000+0000","last_undegraded":"2023-10-14T11:23:55.851000+0000","last_fullsized":"2023-10-14T11:23:55.851000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:34.820154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851889+0000","last_change":"2023-10-14T11:23:53.841253+0000","last_active":"2023-10-14T11:23:55.851889+0000","last_peered":"2023-10-14T11:23:55.851889+0000","last_clean":"2023-10-14T11:23:55.851889+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:23:55.851889+0000","last_undegraded":"2023-10-14T11:23:55.851889+0000","last_fullsized":"2023-10-14T11:23:55.851889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:35:03.774137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.850319+0000","last_change":"2023-10-14T11:23:54.861004+0000","last_active":"2023-10-14T11:23:55.850319+0000","last_peered":"2023-10-14T11:23:55.850319+0000","last_clean":"2023-10-14T11:23:55.850319+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:23:55.850319+0000","last_undegraded":"2023-10-14T11:23:55.850319+0000","last_fullsized":"2023-10-14T11:23:55.850319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:03:37.356750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466847+0000","last_change":"2023-10-14T11:23:53.843058+0000","last_active":"2023-10-14T11:23:56.466847+0000","last_peered":"2023-10-14T11:23:56.466847+0000","last_clean":"2023-10-14T11:23:56.466847+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:23:56.466847+0000","last_undegraded":"2023-10-14T11:23:56.466847+0000","last_fullsized":"2023-10-14T11:23:56.466847+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:31:27.892380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881382+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881382+0000","last_peered":"2023-10-14T11:23:57.881382+0000","last_clean":"2023-10-14T11:23:57.881382+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881382+0000","last_undegraded":"2023-10-14T11:23:57.881382+0000","last_fullsized":"2023-10-14T11:23:57.881382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:30:43.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466801+0000","last_change":"2023-10-14T11:23:53.851026+0000","last_active":"2023-10-14T11:23:56.466801+0000","last_peered":"2023-10-14T11:23:56.466801+0000","last_clean":"2023-10-14T11:23:56.466801+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:23:56.466801+0000","last_undegraded":"2023-10-14T11:23:56.466801+0000","last_fullsized":"2023-10-14T11:23:56.466801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851265+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:55.851265+0000","last_peered":"2023-10-14T11:23:55.851265+0000","last_clean":"2023-10-14T11:23:55.851265+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:55.851265+0000","last_undegraded":"2023-10-14T11:23:55.851265+0000","last_fullsized":"2023-10-14T11:23:55.851265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:21:22.266057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885912+0000","last_change":"2023-10-14T11:23:53.842132+0000","last_active":"2023-10-14T11:23:55.885912+0000","last_peered":"2023-10-14T11:23:55.885912+0000","last_clean":"2023-10-14T11:23:55.885912+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:23:55.885912+0000","last_undegraded":"2023-10-14T11:23:55.885912+0000","last_fullsized":"2023-10-14T11:23:55.885912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:15.441965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605585+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605585+0000","last_peered":"2023-10-14T11:23:57.605585+0000","last_clean":"2023-10-14T11:23:57.605585+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605585+0000","last_undegraded":"2023-10-14T11:23:57.605585+0000","last_fullsized":"2023-10-14T11:23:57.605585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:14:41.859369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.963537+0000","last_change":"2023-10-14T11:23:53.844302+0000","last_active":"2023-10-14T11:23:56.963537+0000","last_peered":"2023-10-14T11:23:56.963537+0000","last_clean":"2023-10-14T11:23:56.963537+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:23:56.963537+0000","last_undegraded":"2023-10-14T11:23:56.963537+0000","last_fullsized":"2023-10-14T11:23:56.963537+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962230+0000","last_change":"2023-10-14T11:23:54.871021+0000","last_active":"2023-10-14T11:23:56.962230+0000","last_peered":"2023-10-14T11:23:56.962230+0000","last_clean":"2023-10-14T11:23:56.962230+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:23:56.962230+0000","last_undegraded":"2023-10-14T11:23:56.962230+0000","last_fullsized":"2023-10-14T11:23:56.962230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885877+0000","last_change":"2023-10-14T11:23:53.850726+0000","last_active":"2023-10-14T11:23:55.885877+0000","last_peered":"2023-10-14T11:23:55.885877+0000","last_clean":"2023-10-14T11:23:55.885877+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:23:55.885877+0000","last_undegraded":"2023-10-14T11:23:55.885877+0000","last_fullsized":"2023-10-14T11:23:55.885877+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:33.851788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851897+0000","last_change":"2023-10-14T11:23:54.860487+0000","last_active":"2023-10-14T11:23:55.851897+0000","last_peered":"2023-10-14T11:23:55.851897+0000","last_clean":"2023-10-14T11:23:55.851897+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:23:55.851897+0000","last_undegraded":"2023-10-14T11:23:55.851897+0000","last_fullsized":"2023-10-14T11:23:55.851897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:00:34.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962069+0000","last_change":"2023-10-14T11:23:53.844354+0000","last_active":"2023-10-14T11:23:56.962069+0000","last_peered":"2023-10-14T11:23:56.962069+0000","last_clean":"2023-10-14T11:23:56.962069+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:23:56.962069+0000","last_undegraded":"2023-10-14T11:23:56.962069+0000","last_fullsized":"2023-10-14T11:23:56.962069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.962351+0000","last_change":"2023-10-14T11:23:54.857940+0000","last_active":"2023-10-14T11:23:56.962351+0000","last_peered":"2023-10-14T11:23:56.962351+0000","last_clean":"2023-10-14T11:23:56.962351+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:23:56.962351+0000","last_undegraded":"2023-10-14T11:23:56.962351+0000","last_fullsized":"2023-10-14T11:23:56.962351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.885744+0000","last_change":"2023-10-14T11:23:53.839365+0000","last_active":"2023-10-14T11:23:55.885744+0000","last_peered":"2023-10-14T11:23:55.885744+0000","last_clean":"2023-10-14T11:23:55.885744+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:23:55.885744+0000","last_undegraded":"2023-10-14T11:23:55.885744+0000","last_fullsized":"2023-10-14T11:23:55.885744+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.852004+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:55.852004+0000","last_peered":"2023-10-14T11:23:55.852004+0000","last_clean":"2023-10-14T11:23:55.852004+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:55.852004+0000","last_undegraded":"2023-10-14T11:23:55.852004+0000","last_fullsized":"2023-10-14T11:23:55.852004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.466866+0000","last_change":"2023-10-14T11:23:53.840206+0000","last_active":"2023-10-14T11:23:56.466866+0000","last_peered":"2023-10-14T11:23:56.466866+0000","last_clean":"2023-10-14T11:23:56.466866+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:23:56.466866+0000","last_undegraded":"2023-10-14T11:23:56.466866+0000","last_fullsized":"2023-10-14T11:23:56.466866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:18:49.553591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881246+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:57.881246+0000","last_peered":"2023-10-14T11:23:57.881246+0000","last_clean":"2023-10-14T11:23:57.881246+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:57.881246+0000","last_undegraded":"2023-10-14T11:23:57.881246+0000","last_fullsized":"2023-10-14T11:23:57.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:06.154919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851610+0000","last_change":"2023-10-14T11:23:53.846302+0000","last_active":"2023-10-14T11:23:55.851610+0000","last_peered":"2023-10-14T11:23:55.851610+0000","last_clean":"2023-10-14T11:23:55.851610+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:23:55.851610+0000","last_undegraded":"2023-10-14T11:23:55.851610+0000","last_fullsized":"2023-10-14T11:23:55.851610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:55:51.210639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881460+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881460+0000","last_peered":"2023-10-14T11:23:57.881460+0000","last_clean":"2023-10-14T11:23:57.881460+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881460+0000","last_undegraded":"2023-10-14T11:23:57.881460+0000","last_fullsized":"2023-10-14T11:23:57.881460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:14.644560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:55.851848+0000","last_change":"2023-10-14T11:23:53.837279+0000","last_active":"2023-10-14T11:23:55.851848+0000","last_peered":"2023-10-14T11:23:55.851848+0000","last_clean":"2023-10-14T11:23:55.851848+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:23:55.851848+0000","last_undegraded":"2023-10-14T11:23:55.851848+0000","last_fullsized":"2023-10-14T11:23:55.851848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:04:35.481096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-14T11:23:54.846831+0000","last_change":"2023-10-14T11:22:54.528205+0000","last_active":"2023-10-14T11:23:54.846831+0000","last_peered":"2023-10-14T11:23:54.846831+0000","last_clean":"2023-10-14T11:23:54.846831+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:23:54.846831+0000","last_undegraded":"2023-10-14T11:23:54.846831+0000","last_fullsized":"2023-10-14T11:23:54.846831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:22:53.413962+0000","last_clean_scrub_stamp":"2023-10-14T11:22:53.413962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:13:45.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.499}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.57899999999999996}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.60499999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.40200000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.623}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.626},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.49299999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.66000000000000003}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64300000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.70299999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.253}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.436}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.47499999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.316},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.42099999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.51900000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66000000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.71799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.35699999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39800000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.38}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61799999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.56000000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.72899999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.29599999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.36199999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.625},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.621},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.53100000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55700000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.441},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46500000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.55300000000000005}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60399999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.629}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:10.109 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.109 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.110 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.110 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.111 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.111 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.112 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.112 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.112 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.113 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.113 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.114 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.114 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.114 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.115 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.115 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.115 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.116 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.116 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.117 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.117 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.117 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.118 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.118 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.119 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.119 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.119 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.120 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.120 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.120 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.121 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.121 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.122 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.122 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.122 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.123 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.123 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.124 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.124 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.124 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.125 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.125 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.125 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.126 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.126 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.127 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.127 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.127 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.128 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.128 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.129 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.129 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.129 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.130 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.130 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.130 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.131 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.131 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.132 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.132 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.132 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.133 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.133 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.133 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.134 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.134 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.135 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.135 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.135 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.136 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.136 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.136 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.137 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.137 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.138 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.138 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.138 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.139 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.139 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.140 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.140 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.140 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.141 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.141 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.141 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.142 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.142 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.143 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.143 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.143 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.144 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.144 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.145 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.145 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.145 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.146 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.146 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T11:22:53.413962+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:10.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T11:24:30.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:30.289 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.287+0000 7f6f71e5d700 1 Processor -- start 2023-10-14T11:24:30.290 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.287+0000 7f6f71e5d700 1 -- start start 2023-10-14T11:24:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f71e5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.293 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f71e5d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f6c06a810 0x7f6f6c06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f71e5d700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c071c50 con 0x7f6f6c159da0 2023-10-14T11:24:30.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f71e5d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c06b1e0 con 0x7f6f6c06a810 2023-10-14T11:24:30.294 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f71e5d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0aec40 con 0x7f6f6c0ae660 2023-10-14T11:24:30.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6b7fe700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f6f6c159da0 0x7f6f6c15e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42886/0 (socket says 172.21.15.67:42886) 2023-10-14T11:24:30.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6b7fe700 1 -- 172.21.15.67:0/1439604016 learned_addr learned my addr 172.21.15.67:0/1439604016 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:30.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6bfff700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f6f6c06a810 0x7f6f6c06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.295 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6affd700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6a7fc700 1 -- 172.21.15.67:0/1439604016 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048749493 0 0) 0x7f6f6c071c50 con 0x7f6f6c159da0 2023-10-14T11:24:30.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6a7fc700 1 -- 172.21.15.67:0/1439604016 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f580035b0 con 0x7f6f6c159da0 2023-10-14T11:24:30.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6bfff700 1 -- 172.21.15.67:0/1439604016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 msgr2=0x7f6f6c0720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:30.296 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6bfff700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.288+0000 7f6f6bfff700 1 -- 172.21.15.67:0/1439604016 >> v1:172.21.15.67:6789/0 conn(0x7f6f6c159da0 legacy=0x7f6f6c15e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f6bfff700 1 -- 172.21.15.67:0/1439604016 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c071320 con 0x7f6f6c06a810 2023-10-14T11:24:30.297 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f6bfff700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c06aca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400aea0 tx=0x7f6f6400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f29c3cd417dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:30.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f6a7fc700 1 -- 172.21.15.67:0/1439604016 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400f070 con 0x7f6f6c06a810 2023-10-14T11:24:30.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f6a7fc700 1 -- 172.21.15.67:0/1439604016 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400a2e0 con 0x7f6f6c06a810 2023-10-14T11:24:30.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f6a7fc700 1 -- 172.21.15.67:0/1439604016 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400cb50 con 0x7f6f6c06a810 2023-10-14T11:24:30.298 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 -- 172.21.15.67:0/1439604016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 msgr2=0x7f6f6c06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c06aca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400aea0 tx=0x7f6f6400c330 comp rx=0 tx=0).stop 2023-10-14T11:24:30.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 -- 172.21.15.67:0/1439604016 shutdown_connections 2023-10-14T11:24:30.299 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c06aca0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/1439604016 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.289+0000 7f6f71e5d700 1 -- 172.21.15.67:0/1439604016 >> 172.21.15.67:0/1439604016 conn(0x7f6f6c0b0f60 msgr2=0x7f6f6c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:30.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.290+0000 7f6f71e5d700 1 -- 172.21.15.67:0/1439604016 shutdown_connections 2023-10-14T11:24:30.300 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.290+0000 7f6f71e5d700 1 -- 172.21.15.67:0/1439604016 wait complete. 2023-10-14T11:24:30.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.291+0000 7f6f71e5d700 1 Processor -- start 2023-10-14T11:24:30.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.291+0000 7f6f71e5d700 1 -- start start 2023-10-14T11:24:30.303 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 0x7f6f6c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0c93d0 con 0x7f6f6c06a810 2023-10-14T11:24:30.304 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b4430 con 0x7f6f6c159da0 2023-10-14T11:24:30.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f71e5d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b35c0 con 0x7f6f6c0ae660 2023-10-14T11:24:30.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.305 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43598/0 (socket says 172.21.15.67:43598) 2023-10-14T11:24:30.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 -- 172.21.15.67:0/2310966869 learned_addr learned my addr 172.21.15.67:0/2310966869 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:30.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6bfff700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 0x7f6f6c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6affd700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.306 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 -- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 msgr2=0x7f6f6c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 -- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 msgr2=0x7f6f6c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.307 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 0x7f6f6c0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 -- 172.21.15.67:0/2310966869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6400ab80 con 0x7f6f6c06a810 2023-10-14T11:24:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6bfff700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 0x7f6f6c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6affd700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:24:30.308 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.292+0000 7f6f6b7fe700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c001eb0 tx=0x7f6f5c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.293+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c005d70 con 0x7f6f6c06a810 2023-10-14T11:24:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.293+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0070d0 con 0x7f6f6c06a810 2023-10-14T11:24:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.293+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c007460 con 0x7f6f6c06a810 2023-10-14T11:24:30.309 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.293+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c0b3820 con 0x7f6f6c06a810 2023-10-14T11:24:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.293+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c0b3de0 con 0x7f6f6c06a810 2023-10-14T11:24:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.294+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c04ebb0 con 0x7f6f6c06a810 2023-10-14T11:24:30.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.294+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f5c0075c0 con 0x7f6f6c06a810 2023-10-14T11:24:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.294+0000 7f6f63fff700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 0x7f6f4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.295+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f6f5c088bd0 con 0x7f6f6c06a810 2023-10-14T11:24:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.295+0000 7f6f6affd700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 0x7f6f4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:30.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.295+0000 7f6f6affd700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 0x7f6f4c06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c14bb20 tx=0x7f6f54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:30.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.299+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f5c053be0 con 0x7f6f6c06a810 2023-10-14T11:24:30.496 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.494+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f6c0718e0 con 0x7f6f4c06af00 2023-10-14T11:24:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.503+0000 7f6f63fff700 1 -- 172.21.15.67:0/2310966869 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288245 (secure 0 0 0) 0x7f6f54009680 con 0x7f6f4c06af00 2023-10-14T11:24:30.509 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:30.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 msgr2=0x7f6f4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 0x7f6f4c06d3c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c14bb20 tx=0x7f6f54008040 comp rx=0 tx=0).stop 2023-10-14T11:24:30.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 msgr2=0x7f6f6c1f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:30.512 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c001eb0 tx=0x7f6f5c00c860 comp rx=0 tx=0).stop 2023-10-14T11:24:30.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 shutdown_connections 2023-10-14T11:24:30.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c159da0 0x7f6f6c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.513 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f6f4c06af00 0x7f6f4c06d3c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f6f6c06a810 0x7f6f6c1f5090 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 --2- 172.21.15.67:0/2310966869 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f6f6c0ae660 0x7f6f6c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 >> 172.21.15.67:0/2310966869 conn(0x7f6f6c0b0f60 msgr2=0x7f6f6c0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 shutdown_connections 2023-10-14T11:24:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:30.506+0000 7f6f71e5d700 1 -- 172.21.15.67:0/2310966869 wait complete. 2023-10-14T11:24:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:30.520 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-10-14T11:24:30.423834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003078"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.618119+0000","last_change":"2023-10-14T11:24:22.618189+0000","last_active":"2023-10-14T11:24:22.618119+0000","last_peered":"2023-10-14T11:24:22.618119+0000","last_clean":"2023-10-14T11:24:22.618119+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:24:22.618119+0000","last_undegraded":"2023-10-14T11:24:22.618119+0000","last_fullsized":"2023-10-14T11:24:22.618119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.618001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:30.049607+0000","scrub_duration":0.00161269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467473+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:56.467473+0000","last_peered":"2023-10-14T11:23:56.467473+0000","last_clean":"2023-10-14T11:23:56.467473+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:56.467473+0000","last_undegraded":"2023-10-14T11:23:56.467473+0000","last_fullsized":"2023-10-14T11:23:56.467473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605488+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605488+0000","last_peered":"2023-10-14T11:23:57.605488+0000","last_clean":"2023-10-14T11:23:57.605488+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605488+0000","last_undegraded":"2023-10-14T11:23:57.605488+0000","last_fullsized":"2023-10-14T11:23:57.605488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:23.043768+0000","last_change":"2023-10-14T11:24:23.043816+0000","last_active":"2023-10-14T11:24:23.043768+0000","last_peered":"2023-10-14T11:24:23.043768+0000","last_clean":"2023-10-14T11:24:23.043768+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:24:23.043768+0000","last_undegraded":"2023-10-14T11:24:23.043768+0000","last_fullsized":"2023-10-14T11:24:23.043768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_clean_scrub_stamp":"2023-10-14T11:24:23.043656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:35.724772+0000","scrub_duration":0.0018187660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467079+0000","last_change":"2023-10-14T11:23:54.865169+0000","last_active":"2023-10-14T11:23:56.467079+0000","last_peered":"2023-10-14T11:23:56.467079+0000","last_clean":"2023-10-14T11:23:56.467079+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:23:56.467079+0000","last_undegraded":"2023-10-14T11:23:56.467079+0000","last_fullsized":"2023-10-14T11:23:56.467079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467380+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:56.467380+0000","last_peered":"2023-10-14T11:23:56.467380+0000","last_clean":"2023-10-14T11:23:56.467380+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:56.467380+0000","last_undegraded":"2023-10-14T11:23:56.467380+0000","last_fullsized":"2023-10-14T11:23:56.467380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.318224+0000","last_change":"2023-10-14T11:24:22.318269+0000","last_active":"2023-10-14T11:24:22.318224+0000","last_peered":"2023-10-14T11:24:22.318224+0000","last_clean":"2023-10-14T11:24:22.318224+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:24:22.318224+0000","last_undegraded":"2023-10-14T11:24:22.318224+0000","last_fullsized":"2023-10-14T11:24:22.318224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.318112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:23.265011+0000","scrub_duration":0.0015173540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881347+0000","last_change":"2023-10-14T11:23:54.862002+0000","last_active":"2023-10-14T11:23:57.881347+0000","last_peered":"2023-10-14T11:23:57.881347+0000","last_clean":"2023-10-14T11:23:57.881347+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:23:57.881347+0000","last_undegraded":"2023-10-14T11:23:57.881347+0000","last_fullsized":"2023-10-14T11:23:57.881347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881911+0000","last_change":"2023-10-14T11:23:54.857854+0000","last_active":"2023-10-14T11:23:57.881911+0000","last_peered":"2023-10-14T11:23:57.881911+0000","last_clean":"2023-10-14T11:23:57.881911+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:23:57.881911+0000","last_undegraded":"2023-10-14T11:23:57.881911+0000","last_fullsized":"2023-10-14T11:23:57.881911+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467743+0000","last_change":"2023-10-14T11:23:54.857845+0000","last_active":"2023-10-14T11:23:56.467743+0000","last_peered":"2023-10-14T11:23:56.467743+0000","last_clean":"2023-10-14T11:23:56.467743+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:23:56.467743+0000","last_undegraded":"2023-10-14T11:23:56.467743+0000","last_fullsized":"2023-10-14T11:23:56.467743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881739+0000","last_change":"2023-10-14T11:23:54.864725+0000","last_active":"2023-10-14T11:23:57.881739+0000","last_peered":"2023-10-14T11:23:57.881739+0000","last_clean":"2023-10-14T11:23:57.881739+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:23:57.881739+0000","last_undegraded":"2023-10-14T11:23:57.881739+0000","last_fullsized":"2023-10-14T11:23:57.881739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605409+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605409+0000","last_peered":"2023-10-14T11:23:57.605409+0000","last_clean":"2023-10-14T11:23:57.605409+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605409+0000","last_undegraded":"2023-10-14T11:23:57.605409+0000","last_fullsized":"2023-10-14T11:23:57.605409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.652454+0000","last_change":"2023-10-14T11:24:12.652527+0000","last_active":"2023-10-14T11:24:12.652454+0000","last_peered":"2023-10-14T11:24:12.652454+0000","last_clean":"2023-10-14T11:24:12.652454+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:24:12.652454+0000","last_undegraded":"2023-10-14T11:24:12.652454+0000","last_fullsized":"2023-10-14T11:24:12.652454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.652307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:57.451092+0000","scrub_duration":0.0018306030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467395+0000","last_change":"2023-10-14T11:23:54.859326+0000","last_active":"2023-10-14T11:23:56.467395+0000","last_peered":"2023-10-14T11:23:56.467395+0000","last_clean":"2023-10-14T11:23:56.467395+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:23:56.467395+0000","last_undegraded":"2023-10-14T11:23:56.467395+0000","last_fullsized":"2023-10-14T11:23:56.467395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605427+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605427+0000","last_peered":"2023-10-14T11:23:57.605427+0000","last_clean":"2023-10-14T11:23:57.605427+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605427+0000","last_undegraded":"2023-10-14T11:23:57.605427+0000","last_fullsized":"2023-10-14T11:23:57.605427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881553+0000","last_change":"2023-10-14T11:23:54.855655+0000","last_active":"2023-10-14T11:23:57.881553+0000","last_peered":"2023-10-14T11:23:57.881553+0000","last_clean":"2023-10-14T11:23:57.881553+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:23:57.881553+0000","last_undegraded":"2023-10-14T11:23:57.881553+0000","last_fullsized":"2023-10-14T11:23:57.881553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881896+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881896+0000","last_peered":"2023-10-14T11:23:57.881896+0000","last_clean":"2023-10-14T11:23:57.881896+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881896+0000","last_undegraded":"2023-10-14T11:23:57.881896+0000","last_fullsized":"2023-10-14T11:23:57.881896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467461+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:56.467461+0000","last_peered":"2023-10-14T11:23:56.467461+0000","last_clean":"2023-10-14T11:23:56.467461+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:56.467461+0000","last_undegraded":"2023-10-14T11:23:56.467461+0000","last_fullsized":"2023-10-14T11:23:56.467461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467438+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:56.467438+0000","last_peered":"2023-10-14T11:23:56.467438+0000","last_clean":"2023-10-14T11:23:56.467438+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:56.467438+0000","last_undegraded":"2023-10-14T11:23:56.467438+0000","last_fullsized":"2023-10-14T11:23:56.467438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467115+0000","last_change":"2023-10-14T11:23:54.862131+0000","last_active":"2023-10-14T11:23:56.467115+0000","last_peered":"2023-10-14T11:23:56.467115+0000","last_clean":"2023-10-14T11:23:56.467115+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:23:56.467115+0000","last_undegraded":"2023-10-14T11:23:56.467115+0000","last_fullsized":"2023-10-14T11:23:56.467115+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881416+0000","last_change":"2023-10-14T11:23:54.860890+0000","last_active":"2023-10-14T11:23:57.881416+0000","last_peered":"2023-10-14T11:23:57.881416+0000","last_clean":"2023-10-14T11:23:57.881416+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:23:57.881416+0000","last_undegraded":"2023-10-14T11:23:57.881416+0000","last_fullsized":"2023-10-14T11:23:57.881416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882055+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882055+0000","last_peered":"2023-10-14T11:23:57.882055+0000","last_clean":"2023-10-14T11:23:57.882055+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882055+0000","last_undegraded":"2023-10-14T11:23:57.882055+0000","last_fullsized":"2023-10-14T11:23:57.882055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.380454+0000","last_change":"2023-10-14T11:24:17.380528+0000","last_active":"2023-10-14T11:24:17.380454+0000","last_peered":"2023-10-14T11:24:17.380454+0000","last_clean":"2023-10-14T11:24:17.380454+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:24:17.380454+0000","last_undegraded":"2023-10-14T11:24:17.380454+0000","last_fullsized":"2023-10-14T11:24:17.380454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.380311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:49.314225+0000","scrub_duration":0.0020088469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.649868+0000","last_change":"2023-10-14T11:24:25.649924+0000","last_active":"2023-10-14T11:24:25.649868+0000","last_peered":"2023-10-14T11:24:25.649868+0000","last_clean":"2023-10-14T11:24:25.649868+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:24:25.649868+0000","last_undegraded":"2023-10-14T11:24:25.649868+0000","last_fullsized":"2023-10-14T11:24:25.649868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.649757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:50.342876+0000","scrub_duration":0.001768936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.032513+0000","last_change":"2023-10-14T11:24:24.032590+0000","last_active":"2023-10-14T11:24:24.032513+0000","last_peered":"2023-10-14T11:24:24.032513+0000","last_clean":"2023-10-14T11:24:24.032513+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:24:24.032513+0000","last_undegraded":"2023-10-14T11:24:24.032513+0000","last_fullsized":"2023-10-14T11:24:24.032513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.032364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:49.045417+0000","scrub_duration":0.0021628229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467484+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:56.467484+0000","last_peered":"2023-10-14T11:23:56.467484+0000","last_clean":"2023-10-14T11:23:56.467484+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:56.467484+0000","last_undegraded":"2023-10-14T11:23:56.467484+0000","last_fullsized":"2023-10-14T11:23:56.467484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467731+0000","last_change":"2023-10-14T11:23:54.860124+0000","last_active":"2023-10-14T11:23:56.467731+0000","last_peered":"2023-10-14T11:23:56.467731+0000","last_clean":"2023-10-14T11:23:56.467731+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:23:56.467731+0000","last_undegraded":"2023-10-14T11:23:56.467731+0000","last_fullsized":"2023-10-14T11:23:56.467731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605520+0000","last_change":"2023-10-14T11:23:54.853435+0000","last_active":"2023-10-14T11:23:57.605520+0000","last_peered":"2023-10-14T11:23:57.605520+0000","last_clean":"2023-10-14T11:23:57.605520+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:23:57.605520+0000","last_undegraded":"2023-10-14T11:23:57.605520+0000","last_fullsized":"2023-10-14T11:23:57.605520+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882104+0000","last_change":"2023-10-14T11:23:54.854996+0000","last_active":"2023-10-14T11:23:57.882104+0000","last_peered":"2023-10-14T11:23:57.882104+0000","last_clean":"2023-10-14T11:23:57.882104+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:23:57.882104+0000","last_undegraded":"2023-10-14T11:23:57.882104+0000","last_fullsized":"2023-10-14T11:23:57.882104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881374+0000","last_change":"2023-10-14T11:23:54.857911+0000","last_active":"2023-10-14T11:23:57.881374+0000","last_peered":"2023-10-14T11:23:57.881374+0000","last_clean":"2023-10-14T11:23:57.881374+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:23:57.881374+0000","last_undegraded":"2023-10-14T11:23:57.881374+0000","last_fullsized":"2023-10-14T11:23:57.881374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.612889+0000","last_change":"2023-10-14T11:24:19.612977+0000","last_active":"2023-10-14T11:24:19.612889+0000","last_peered":"2023-10-14T11:24:19.612889+0000","last_clean":"2023-10-14T11:24:19.612889+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:24:19.612889+0000","last_undegraded":"2023-10-14T11:24:19.612889+0000","last_fullsized":"2023-10-14T11:24:19.612889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.612775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:28.923551+0000","scrub_duration":0.0020682040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.353591+0000","last_change":"2023-10-14T11:24:18.353635+0000","last_active":"2023-10-14T11:24:18.353591+0000","last_peered":"2023-10-14T11:24:18.353591+0000","last_clean":"2023-10-14T11:24:18.353591+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:24:18.353591+0000","last_undegraded":"2023-10-14T11:24:18.353591+0000","last_fullsized":"2023-10-14T11:24:18.353591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.353458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:12.119177+0000","scrub_duration":0.001475496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.371536+0000","last_change":"2023-10-14T11:24:26.371583+0000","last_active":"2023-10-14T11:24:26.371536+0000","last_peered":"2023-10-14T11:24:26.371536+0000","last_clean":"2023-10-14T11:24:26.371536+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:24:26.371536+0000","last_undegraded":"2023-10-14T11:24:26.371536+0000","last_fullsized":"2023-10-14T11:24:26.371536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.371421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:10.031597+0000","scrub_duration":0.002261239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.572146+0000","last_change":"2023-10-14T11:24:12.572201+0000","last_active":"2023-10-14T11:24:12.572146+0000","last_peered":"2023-10-14T11:24:12.572146+0000","last_clean":"2023-10-14T11:24:12.572146+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:24:12.572146+0000","last_undegraded":"2023-10-14T11:24:12.572146+0000","last_fullsized":"2023-10-14T11:24:12.572146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.572029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:05.536861+0000","scrub_duration":0.0021884140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.588810+0000","last_change":"2023-10-14T11:24:20.588873+0000","last_active":"2023-10-14T11:24:20.588810+0000","last_peered":"2023-10-14T11:24:20.588810+0000","last_clean":"2023-10-14T11:24:20.588810+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:24:20.588810+0000","last_undegraded":"2023-10-14T11:24:20.588810+0000","last_fullsized":"2023-10-14T11:24:20.588810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.588675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:49.622214+0000","scrub_duration":0.0016745919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.359903+0000","last_change":"2023-10-14T11:24:16.359975+0000","last_active":"2023-10-14T11:24:16.359903+0000","last_peered":"2023-10-14T11:24:16.359903+0000","last_clean":"2023-10-14T11:24:16.359903+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:24:16.359903+0000","last_undegraded":"2023-10-14T11:24:16.359903+0000","last_fullsized":"2023-10-14T11:24:16.359903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.359793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.129129+0000","scrub_duration":0.002300818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881700+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881700+0000","last_peered":"2023-10-14T11:23:57.881700+0000","last_clean":"2023-10-14T11:23:57.881700+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881700+0000","last_undegraded":"2023-10-14T11:23:57.881700+0000","last_fullsized":"2023-10-14T11:23:57.881700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.224194+0000","last_change":"2023-10-14T11:24:25.224252+0000","last_active":"2023-10-14T11:24:25.224194+0000","last_peered":"2023-10-14T11:24:25.224194+0000","last_clean":"2023-10-14T11:24:25.224194+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:24:25.224194+0000","last_undegraded":"2023-10-14T11:24:25.224194+0000","last_fullsized":"2023-10-14T11:24:25.224194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.224080+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:08.054276+0000","scrub_duration":0.0030700860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467721+0000","last_change":"2023-10-14T11:23:54.859377+0000","last_active":"2023-10-14T11:23:56.467721+0000","last_peered":"2023-10-14T11:23:56.467721+0000","last_clean":"2023-10-14T11:23:56.467721+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:23:56.467721+0000","last_undegraded":"2023-10-14T11:23:56.467721+0000","last_fullsized":"2023-10-14T11:23:56.467721+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.657769+0000","last_change":"2023-10-14T11:24:10.657818+0000","last_active":"2023-10-14T11:24:10.657769+0000","last_peered":"2023-10-14T11:24:10.657769+0000","last_clean":"2023-10-14T11:24:10.657769+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:24:10.657769+0000","last_undegraded":"2023-10-14T11:24:10.657769+0000","last_fullsized":"2023-10-14T11:24:10.657769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.657669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:51.690631+0000","scrub_duration":0.0017120919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881530+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881530+0000","last_peered":"2023-10-14T11:23:57.881530+0000","last_clean":"2023-10-14T11:23:57.881530+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881530+0000","last_undegraded":"2023-10-14T11:23:57.881530+0000","last_fullsized":"2023-10-14T11:23:57.881530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.955178+0000","last_change":"2023-10-14T11:24:22.955233+0000","last_active":"2023-10-14T11:24:22.955178+0000","last_peered":"2023-10-14T11:24:22.955178+0000","last_clean":"2023-10-14T11:24:22.955178+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:24:22.955178+0000","last_undegraded":"2023-10-14T11:24:22.955178+0000","last_fullsized":"2023-10-14T11:24:22.955178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.955060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:16.720779+0000","scrub_duration":0.0019597210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605637+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605637+0000","last_peered":"2023-10-14T11:23:57.605637+0000","last_clean":"2023-10-14T11:23:57.605637+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605637+0000","last_undegraded":"2023-10-14T11:23:57.605637+0000","last_fullsized":"2023-10-14T11:23:57.605637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.031156+0000","last_change":"2023-10-14T11:24:19.031223+0000","last_active":"2023-10-14T11:24:19.031156+0000","last_peered":"2023-10-14T11:24:19.031156+0000","last_clean":"2023-10-14T11:24:19.031156+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:24:19.031156+0000","last_undegraded":"2023-10-14T11:24:19.031156+0000","last_fullsized":"2023-10-14T11:24:19.031156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.031043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:14.404949+0000","scrub_duration":0.002047484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881956+0000","last_change":"2023-10-14T11:23:54.854959+0000","last_active":"2023-10-14T11:23:57.881956+0000","last_peered":"2023-10-14T11:23:57.881956+0000","last_clean":"2023-10-14T11:23:57.881956+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:23:57.881956+0000","last_undegraded":"2023-10-14T11:23:57.881956+0000","last_fullsized":"2023-10-14T11:23:57.881956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.033528+0000","last_change":"2023-10-14T11:24:16.033579+0000","last_active":"2023-10-14T11:24:16.033528+0000","last_peered":"2023-10-14T11:24:16.033528+0000","last_clean":"2023-10-14T11:24:16.033528+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:24:16.033528+0000","last_undegraded":"2023-10-14T11:24:16.033528+0000","last_fullsized":"2023-10-14T11:24:16.033528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.033420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:16.980319+0000","scrub_duration":0.0015776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467579+0000","last_change":"2023-10-14T11:23:54.856068+0000","last_active":"2023-10-14T11:23:56.467579+0000","last_peered":"2023-10-14T11:23:56.467579+0000","last_clean":"2023-10-14T11:23:56.467579+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:23:56.467579+0000","last_undegraded":"2023-10-14T11:23:56.467579+0000","last_fullsized":"2023-10-14T11:23:56.467579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.918317+0000","last_change":"2023-10-14T11:24:12.918415+0000","last_active":"2023-10-14T11:24:12.918317+0000","last_peered":"2023-10-14T11:24:12.918317+0000","last_clean":"2023-10-14T11:24:12.918317+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:24:12.918317+0000","last_undegraded":"2023-10-14T11:24:12.918317+0000","last_fullsized":"2023-10-14T11:24:12.918317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.918195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:41.951734+0000","scrub_duration":0.001509102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605639+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605639+0000","last_peered":"2023-10-14T11:23:57.605639+0000","last_clean":"2023-10-14T11:23:57.605639+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605639+0000","last_undegraded":"2023-10-14T11:23:57.605639+0000","last_fullsized":"2023-10-14T11:23:57.605639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.117423+0000","last_change":"2023-10-14T11:24:20.117501+0000","last_active":"2023-10-14T11:24:20.117423+0000","last_peered":"2023-10-14T11:24:20.117423+0000","last_clean":"2023-10-14T11:24:20.117423+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:24:20.117423+0000","last_undegraded":"2023-10-14T11:24:20.117423+0000","last_fullsized":"2023-10-14T11:24:20.117423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.117283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:09.147754+0000","scrub_duration":0.002212463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467504+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:56.467504+0000","last_peered":"2023-10-14T11:23:56.467504+0000","last_clean":"2023-10-14T11:23:56.467504+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:56.467504+0000","last_undegraded":"2023-10-14T11:23:56.467504+0000","last_fullsized":"2023-10-14T11:23:56.467504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.367700+0000","last_change":"2023-10-14T11:24:15.367749+0000","last_active":"2023-10-14T11:24:15.367700+0000","last_peered":"2023-10-14T11:24:15.367700+0000","last_clean":"2023-10-14T11:24:15.367700+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:24:15.367700+0000","last_undegraded":"2023-10-14T11:24:15.367700+0000","last_fullsized":"2023-10-14T11:24:15.367700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.367586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:36.189165+0000","scrub_duration":0.001682048,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.001748+0000","last_change":"2023-10-14T11:24:10.001813+0000","last_active":"2023-10-14T11:24:10.001748+0000","last_peered":"2023-10-14T11:24:10.001748+0000","last_clean":"2023-10-14T11:24:10.001748+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:24:10.001748+0000","last_undegraded":"2023-10-14T11:24:10.001748+0000","last_fullsized":"2023-10-14T11:24:10.001748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.001627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:51.478987+0000","scrub_duration":0.001776112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.629817+0000","last_change":"2023-10-14T11:24:22.629870+0000","last_active":"2023-10-14T11:24:22.629817+0000","last_peered":"2023-10-14T11:24:22.629817+0000","last_clean":"2023-10-14T11:24:22.629817+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:24:22.629817+0000","last_undegraded":"2023-10-14T11:24:22.629817+0000","last_fullsized":"2023-10-14T11:24:22.629817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.629697+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:04.107057+0000","scrub_duration":0.0021629869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605584+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605584+0000","last_peered":"2023-10-14T11:23:57.605584+0000","last_clean":"2023-10-14T11:23:57.605584+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605584+0000","last_undegraded":"2023-10-14T11:23:57.605584+0000","last_fullsized":"2023-10-14T11:23:57.605584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:14.989113+0000","last_change":"2023-10-14T11:24:14.989170+0000","last_active":"2023-10-14T11:24:14.989113+0000","last_peered":"2023-10-14T11:24:14.989113+0000","last_clean":"2023-10-14T11:24:14.989113+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:24:14.989113+0000","last_undegraded":"2023-10-14T11:24:14.989113+0000","last_fullsized":"2023-10-14T11:24:14.989113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_clean_scrub_stamp":"2023-10-14T11:24:14.988999+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:08.754718+0000","scrub_duration":0.0030364979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.174066+0000","last_change":"2023-10-14T11:24:18.174117+0000","last_active":"2023-10-14T11:24:18.174066+0000","last_peered":"2023-10-14T11:24:18.174066+0000","last_clean":"2023-10-14T11:24:18.174066+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:24:18.174066+0000","last_undegraded":"2023-10-14T11:24:18.174066+0000","last_fullsized":"2023-10-14T11:24:18.174066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.173944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:01.834121+0000","scrub_duration":0.0025641790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.947992+0000","last_change":"2023-10-14T11:24:13.948045+0000","last_active":"2023-10-14T11:24:13.947992+0000","last_peered":"2023-10-14T11:24:13.947992+0000","last_clean":"2023-10-14T11:24:13.947992+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:24:13.947992+0000","last_undegraded":"2023-10-14T11:24:13.947992+0000","last_fullsized":"2023-10-14T11:24:13.947992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.947888+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:11.579179+0000","scrub_duration":0.002298937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467406+0000","last_change":"2023-10-14T11:23:54.853115+0000","last_active":"2023-10-14T11:23:56.467406+0000","last_peered":"2023-10-14T11:23:56.467406+0000","last_clean":"2023-10-14T11:23:56.467406+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:23:56.467406+0000","last_undegraded":"2023-10-14T11:23:56.467406+0000","last_fullsized":"2023-10-14T11:23:56.467406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.193107+0000","last_change":"2023-10-14T11:24:15.193158+0000","last_active":"2023-10-14T11:24:15.193107+0000","last_peered":"2023-10-14T11:24:15.193107+0000","last_clean":"2023-10-14T11:24:15.193107+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:24:15.193107+0000","last_undegraded":"2023-10-14T11:24:15.193107+0000","last_fullsized":"2023-10-14T11:24:15.193107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.193011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:15.570002+0000","scrub_duration":0.0020719250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881689+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881689+0000","last_peered":"2023-10-14T11:23:57.881689+0000","last_clean":"2023-10-14T11:23:57.881689+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881689+0000","last_undegraded":"2023-10-14T11:23:57.881689+0000","last_fullsized":"2023-10-14T11:23:57.881689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.075214+0000","last_change":"2023-10-14T11:24:18.075260+0000","last_active":"2023-10-14T11:24:18.075214+0000","last_peered":"2023-10-14T11:24:18.075214+0000","last_clean":"2023-10-14T11:24:18.075214+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:24:18.075214+0000","last_undegraded":"2023-10-14T11:24:18.075214+0000","last_fullsized":"2023-10-14T11:24:18.075214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.075105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:57:07.333526+0000","scrub_duration":0.0020020939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.600778+0000","last_change":"2023-10-14T11:24:18.600826+0000","last_active":"2023-10-14T11:24:18.600778+0000","last_peered":"2023-10-14T11:24:18.600778+0000","last_clean":"2023-10-14T11:24:18.600778+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:24:18.600778+0000","last_undegraded":"2023-10-14T11:24:18.600778+0000","last_fullsized":"2023-10-14T11:24:18.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.600643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:39.422221+0000","scrub_duration":0.001627075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.039119+0000","last_change":"2023-10-14T11:24:17.039213+0000","last_active":"2023-10-14T11:24:17.039119+0000","last_peered":"2023-10-14T11:24:17.039119+0000","last_clean":"2023-10-14T11:24:17.039119+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:24:17.039119+0000","last_undegraded":"2023-10-14T11:24:17.039119+0000","last_fullsized":"2023-10-14T11:24:17.039119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.038941+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:35.598811+0000","scrub_duration":0.0024319699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881744+0000","last_change":"2023-10-14T11:23:54.853401+0000","last_active":"2023-10-14T11:23:57.881744+0000","last_peered":"2023-10-14T11:23:57.881744+0000","last_clean":"2023-10-14T11:23:57.881744+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:23:57.881744+0000","last_undegraded":"2023-10-14T11:23:57.881744+0000","last_fullsized":"2023-10-14T11:23:57.881744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:07.216148+0000","last_change":"2023-10-14T11:24:07.216215+0000","last_active":"2023-10-14T11:24:07.216148+0000","last_peered":"2023-10-14T11:24:07.216148+0000","last_clean":"2023-10-14T11:24:07.216148+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:24:07.216148+0000","last_undegraded":"2023-10-14T11:24:07.216148+0000","last_fullsized":"2023-10-14T11:24:07.216148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_clean_scrub_stamp":"2023-10-14T11:24:07.216014+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:28.037593+0000","scrub_duration":0.001805564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605730+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605730+0000","last_peered":"2023-10-14T11:23:57.605730+0000","last_clean":"2023-10-14T11:23:57.605730+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605730+0000","last_undegraded":"2023-10-14T11:23:57.605730+0000","last_fullsized":"2023-10-14T11:23:57.605730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881812+0000","last_change":"2023-10-14T11:23:53.836942+0000","last_active":"2023-10-14T11:23:57.881812+0000","last_peered":"2023-10-14T11:23:57.881812+0000","last_clean":"2023-10-14T11:23:57.881812+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:23:57.881812+0000","last_undegraded":"2023-10-14T11:23:57.881812+0000","last_fullsized":"2023-10-14T11:23:57.881812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:52.818826+0000","last_clean_scrub_stamp":"2023-10-14T11:23:52.818826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467694+0000","last_change":"2023-10-14T11:23:54.859846+0000","last_active":"2023-10-14T11:23:56.467694+0000","last_peered":"2023-10-14T11:23:56.467694+0000","last_clean":"2023-10-14T11:23:56.467694+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:23:56.467694+0000","last_undegraded":"2023-10-14T11:23:56.467694+0000","last_fullsized":"2023-10-14T11:23:56.467694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.964012+0000","last_change":"2023-10-14T11:24:11.964066+0000","last_active":"2023-10-14T11:24:11.964012+0000","last_peered":"2023-10-14T11:24:11.964012+0000","last_clean":"2023-10-14T11:24:11.964012+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:24:11.964012+0000","last_undegraded":"2023-10-14T11:24:11.964012+0000","last_fullsized":"2023-10-14T11:24:11.964012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.963898+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:00.000285+0000","scrub_duration":0.0025292790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467140+0000","last_change":"2023-10-14T11:23:54.866930+0000","last_active":"2023-10-14T11:23:56.467140+0000","last_peered":"2023-10-14T11:23:56.467140+0000","last_clean":"2023-10-14T11:23:56.467140+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:23:56.467140+0000","last_undegraded":"2023-10-14T11:23:56.467140+0000","last_fullsized":"2023-10-14T11:23:56.467140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.997169+0000","last_change":"2023-10-14T11:24:24.997231+0000","last_active":"2023-10-14T11:24:24.997169+0000","last_peered":"2023-10-14T11:24:24.997169+0000","last_clean":"2023-10-14T11:24:24.997169+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:24:24.997169+0000","last_undegraded":"2023-10-14T11:24:24.997169+0000","last_fullsized":"2023-10-14T11:24:24.997169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.997051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:25.943950+0000","scrub_duration":0.0018370400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.658392+0000","last_change":"2023-10-14T11:24:16.658443+0000","last_active":"2023-10-14T11:24:16.658392+0000","last_peered":"2023-10-14T11:24:16.658392+0000","last_clean":"2023-10-14T11:24:16.658392+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:24:16.658392+0000","last_undegraded":"2023-10-14T11:24:16.658392+0000","last_fullsized":"2023-10-14T11:24:16.658392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.658265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:09.623097+0000","scrub_duration":0.002318826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:06.515192+0000","last_change":"2023-10-14T11:24:06.515272+0000","last_active":"2023-10-14T11:24:06.515192+0000","last_peered":"2023-10-14T11:24:06.515192+0000","last_clean":"2023-10-14T11:24:06.515192+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:24:06.515192+0000","last_undegraded":"2023-10-14T11:24:06.515192+0000","last_fullsized":"2023-10-14T11:24:06.515192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_clean_scrub_stamp":"2023-10-14T11:24:06.515039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:17.317480+0000","scrub_duration":0.001648042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.679270+0000","last_change":"2023-10-14T11:24:20.679372+0000","last_active":"2023-10-14T11:24:20.679270+0000","last_peered":"2023-10-14T11:24:20.679270+0000","last_clean":"2023-10-14T11:24:20.679270+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:24:20.679270+0000","last_undegraded":"2023-10-14T11:24:20.679270+0000","last_fullsized":"2023-10-14T11:24:20.679270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.679137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:25.181756+0000","scrub_duration":0.0016657740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.623905+0000","last_change":"2023-10-14T11:24:16.623954+0000","last_active":"2023-10-14T11:24:16.623905+0000","last_peered":"2023-10-14T11:24:16.623905+0000","last_clean":"2023-10-14T11:24:16.623905+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:24:16.623905+0000","last_undegraded":"2023-10-14T11:24:16.623905+0000","last_fullsized":"2023-10-14T11:24:16.623905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.623790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:10.423515+0000","scrub_duration":0.0020869059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.646219+0000","last_change":"2023-10-14T11:24:11.646268+0000","last_active":"2023-10-14T11:24:11.646219+0000","last_peered":"2023-10-14T11:24:11.646219+0000","last_clean":"2023-10-14T11:24:11.646219+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:24:11.646219+0000","last_undegraded":"2023-10-14T11:24:11.646219+0000","last_fullsized":"2023-10-14T11:24:11.646219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.646099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:23.978037+0000","scrub_duration":0.001698242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.988120+0000","last_change":"2023-10-14T11:24:17.988172+0000","last_active":"2023-10-14T11:24:17.988120+0000","last_peered":"2023-10-14T11:24:17.988120+0000","last_clean":"2023-10-14T11:24:17.988120+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:24:17.988120+0000","last_undegraded":"2023-10-14T11:24:17.988120+0000","last_fullsized":"2023-10-14T11:24:17.988120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.988015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:59.465375+0000","scrub_duration":0.0020367390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881425+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881425+0000","last_peered":"2023-10-14T11:23:57.881425+0000","last_clean":"2023-10-14T11:23:57.881425+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881425+0000","last_undegraded":"2023-10-14T11:23:57.881425+0000","last_fullsized":"2023-10-14T11:23:57.881425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.626811+0000","last_change":"2023-10-14T11:24:24.626862+0000","last_active":"2023-10-14T11:24:24.626811+0000","last_peered":"2023-10-14T11:24:24.626811+0000","last_clean":"2023-10-14T11:24:24.626811+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:24:24.626811+0000","last_undegraded":"2023-10-14T11:24:24.626811+0000","last_fullsized":"2023-10-14T11:24:24.626811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.626702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:08.286879+0000","scrub_duration":0.001499691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467153+0000","last_change":"2023-10-14T11:23:54.864480+0000","last_active":"2023-10-14T11:23:56.467153+0000","last_peered":"2023-10-14T11:23:56.467153+0000","last_clean":"2023-10-14T11:23:56.467153+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:23:56.467153+0000","last_undegraded":"2023-10-14T11:23:56.467153+0000","last_fullsized":"2023-10-14T11:23:56.467153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.137672+0000","last_change":"2023-10-14T11:24:12.137759+0000","last_active":"2023-10-14T11:24:12.137672+0000","last_peered":"2023-10-14T11:24:12.137672+0000","last_clean":"2023-10-14T11:24:12.137672+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:24:12.137672+0000","last_undegraded":"2023-10-14T11:24:12.137672+0000","last_fullsized":"2023-10-14T11:24:12.137672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.137511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:19.569117+0000","scrub_duration":0.0022568279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605641+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605641+0000","last_peered":"2023-10-14T11:23:57.605641+0000","last_clean":"2023-10-14T11:23:57.605641+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605641+0000","last_undegraded":"2023-10-14T11:23:57.605641+0000","last_fullsized":"2023-10-14T11:23:57.605641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.379212+0000","last_change":"2023-10-14T11:24:13.379271+0000","last_active":"2023-10-14T11:24:13.379212+0000","last_peered":"2023-10-14T11:24:13.379212+0000","last_clean":"2023-10-14T11:24:13.379212+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:24:13.379212+0000","last_undegraded":"2023-10-14T11:24:13.379212+0000","last_fullsized":"2023-10-14T11:24:13.379212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.379092+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:17.881711+0000","scrub_duration":0.00205668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.349746+0000","last_change":"2023-10-14T11:24:18.349802+0000","last_active":"2023-10-14T11:24:18.349746+0000","last_peered":"2023-10-14T11:24:18.349746+0000","last_clean":"2023-10-14T11:24:18.349746+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:24:18.349746+0000","last_undegraded":"2023-10-14T11:24:18.349746+0000","last_fullsized":"2023-10-14T11:24:18.349746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.349596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:15.980887+0000","scrub_duration":0.0016496950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.201195+0000","last_change":"2023-10-14T11:24:16.201259+0000","last_active":"2023-10-14T11:24:16.201195+0000","last_peered":"2023-10-14T11:24:16.201195+0000","last_clean":"2023-10-14T11:24:16.201195+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:24:16.201195+0000","last_undegraded":"2023-10-14T11:24:16.201195+0000","last_fullsized":"2023-10-14T11:24:16.201195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.201090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:24.787692+0000","scrub_duration":0.0016295120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.661091+0000","last_change":"2023-10-14T11:24:25.661135+0000","last_active":"2023-10-14T11:24:25.661091+0000","last_peered":"2023-10-14T11:24:25.661091+0000","last_clean":"2023-10-14T11:24:25.661091+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:24:25.661091+0000","last_undegraded":"2023-10-14T11:24:25.661091+0000","last_fullsized":"2023-10-14T11:24:25.661091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.660987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:27.875126+0000","scrub_duration":0.0019431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.446770+0000","last_change":"2023-10-14T11:24:10.446815+0000","last_active":"2023-10-14T11:24:10.446770+0000","last_peered":"2023-10-14T11:24:10.446770+0000","last_clean":"2023-10-14T11:24:10.446770+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:24:10.446770+0000","last_undegraded":"2023-10-14T11:24:10.446770+0000","last_fullsized":"2023-10-14T11:24:10.446770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.446679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:49.333800+0000","scrub_duration":0.0018293230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.387752+0000","last_change":"2023-10-14T11:24:20.387801+0000","last_active":"2023-10-14T11:24:20.387752+0000","last_peered":"2023-10-14T11:24:20.387752+0000","last_clean":"2023-10-14T11:24:20.387752+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:24:20.387752+0000","last_undegraded":"2023-10-14T11:24:20.387752+0000","last_fullsized":"2023-10-14T11:24:20.387752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.387627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:28.974229+0000","scrub_duration":0.001943073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:08.171269+0000","last_change":"2023-10-14T11:24:08.171308+0000","last_active":"2023-10-14T11:24:08.171269+0000","last_peered":"2023-10-14T11:24:08.171269+0000","last_clean":"2023-10-14T11:24:08.171269+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:24:08.171269+0000","last_undegraded":"2023-10-14T11:24:08.171269+0000","last_fullsized":"2023-10-14T11:24:08.171269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_clean_scrub_stamp":"2023-10-14T11:24:08.171180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:17.481955+0000","scrub_duration":0.0018328719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467347+0000","last_change":"2023-10-14T11:23:54.847022+0000","last_active":"2023-10-14T11:23:56.467347+0000","last_peered":"2023-10-14T11:23:56.467347+0000","last_clean":"2023-10-14T11:23:56.467347+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:23:56.467347+0000","last_undegraded":"2023-10-14T11:23:56.467347+0000","last_fullsized":"2023-10-14T11:23:56.467347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.978070+0000","last_change":"2023-10-14T11:24:15.978119+0000","last_active":"2023-10-14T11:24:15.978070+0000","last_peered":"2023-10-14T11:24:15.978070+0000","last_clean":"2023-10-14T11:24:15.978070+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:24:15.978070+0000","last_undegraded":"2023-10-14T11:24:15.978070+0000","last_fullsized":"2023-10-14T11:24:15.978070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.977938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:18.192077+0000","scrub_duration":0.0017069959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881297+0000","last_change":"2023-10-14T11:23:54.858368+0000","last_active":"2023-10-14T11:23:57.881297+0000","last_peered":"2023-10-14T11:23:57.881297+0000","last_clean":"2023-10-14T11:23:57.881297+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:23:57.881297+0000","last_undegraded":"2023-10-14T11:23:57.881297+0000","last_fullsized":"2023-10-14T11:23:57.881297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.980966+0000","last_change":"2023-10-14T11:24:10.981021+0000","last_active":"2023-10-14T11:24:10.980966+0000","last_peered":"2023-10-14T11:24:10.980966+0000","last_clean":"2023-10-14T11:24:10.980966+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:24:10.980966+0000","last_undegraded":"2023-10-14T11:24:10.980966+0000","last_fullsized":"2023-10-14T11:24:10.980966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.980842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:54.641019+0000","scrub_duration":0.0019702180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881509+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881509+0000","last_peered":"2023-10-14T11:23:57.881509+0000","last_clean":"2023-10-14T11:23:57.881509+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881509+0000","last_undegraded":"2023-10-14T11:23:57.881509+0000","last_fullsized":"2023-10-14T11:23:57.881509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.561706+0000","last_change":"2023-10-14T11:24:10.561759+0000","last_active":"2023-10-14T11:24:10.561706+0000","last_peered":"2023-10-14T11:24:10.561706+0000","last_clean":"2023-10-14T11:24:10.561706+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:24:10.561706+0000","last_undegraded":"2023-10-14T11:24:10.561706+0000","last_fullsized":"2023-10-14T11:24:10.561706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.561597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:55.360382+0000","scrub_duration":0.0015897629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.419258+0000","last_change":"2023-10-14T11:24:11.419316+0000","last_active":"2023-10-14T11:24:11.419258+0000","last_peered":"2023-10-14T11:24:11.419258+0000","last_clean":"2023-10-14T11:24:11.419258+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:24:11.419258+0000","last_undegraded":"2023-10-14T11:24:11.419258+0000","last_fullsized":"2023-10-14T11:24:11.419258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.419125+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:27.365475+0000","scrub_duration":0.0059804070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.73199999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.78900000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.77600000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.751}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.626}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.626}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69599999999999995}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.71299999999999997}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48199999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57299999999999995}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.35299999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.76600000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.61099999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.249},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.307}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.38},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.42599999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.48799999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39000000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.442},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.68200000000000005}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.504},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.32900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.374}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65500000000000003}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.55400000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.70199999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.59099999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.57599999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.44500000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.48299999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.496},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.69299999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.56200000000000006}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.622}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.75700000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46200000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.435},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:30.527 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.527 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.528 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.528 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.529 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.529 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.529 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.530 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.530 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.531 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.531 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.531 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.532 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.532 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.533 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.533 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.534 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.534 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.534 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.535 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.535 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.536 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.536 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.537 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.537 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.538 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.538 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.539 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.539 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.539 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.540 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.540 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.541 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.541 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.542 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.542 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.543 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-10-14T11:23:52.818826+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=52, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.543 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.543 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.544 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.544 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.545 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.545 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.545 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.546 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:30.546 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T11:24:34.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:24:34.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:24:50.548 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:24:50.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.685+0000 7f9014e4a700 1 Processor -- start 2023-10-14T11:24:50.688 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.685+0000 7f9014e4a700 1 -- start start 2023-10-14T11:24:50.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f9014e4a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f90100c5be0 0x7f901006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.691 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f9014e4a700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f901006adc0 0x7f9010071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f9014e4a700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901015de40 con 0x7f901015da60 2023-10-14T11:24:50.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f9014e4a700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90101624b0 con 0x7f901006adc0 2023-10-14T11:24:50.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f9014e4a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90101616f0 con 0x7f90100c5be0 2023-10-14T11:24:50.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900e59c700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f901015da60 0x7f90100c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42900/0 (socket says 172.21.15.67:42900) 2023-10-14T11:24:50.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900e59c700 1 -- 172.21.15.67:0/3927552021 learned_addr learned my addr 172.21.15.67:0/3927552021 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:24:50.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900ed9d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f901006adc0 0x7f9010071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900dd9b700 1 --2- 172.21.15.67:0/3927552021 >> v2:172.21.15.72:3300/0 conn(0x7f90100c5be0 0x7f901006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900ed9d700 1 -- 172.21.15.67:0/3927552021 >> v2:172.21.15.72:3300/0 conn(0x7f90100c5be0 msgr2=0x7f901006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:24:50.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900ed9d700 1 --2- 172.21.15.67:0/3927552021 >> v2:172.21.15.72:3300/0 conn(0x7f90100c5be0 0x7f901006a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900ed9d700 1 -- 172.21.15.67:0/3927552021 >> v1:172.21.15.67:6789/0 conn(0x7f901015da60 legacy=0x7f90100c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900ed9d700 1 -- 172.21.15.67:0/3927552021 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90101619d0 con 0x7f901006adc0 2023-10-14T11:24:50.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.686+0000 7f900d59a700 1 -- 172.21.15.67:0/3927552021 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251965884 0 0) 0x7f901015de40 con 0x7f901015da60 2023-10-14T11:24:50.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f900ed9d700 1 --2- 172.21.15.67:0/3927552021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f901006adc0 0x7f9010071be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f90100afab0 tx=0x7f900800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21065dc0cdd14051 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:50.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f900d59a700 1 -- 172.21.15.67:0/3927552021 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800e070 con 0x7f901006adc0 2023-10-14T11:24:50.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f900d59a700 1 -- 172.21.15.67:0/3927552021 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800bbd0 con 0x7f901006adc0 2023-10-14T11:24:50.696 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f900d59a700 1 -- 172.21.15.67:0/3927552021 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9008012430 con 0x7f901006adc0 2023-10-14T11:24:50.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 -- 172.21.15.67:0/3927552021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f901006adc0 msgr2=0x7f9010071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 --2- 172.21.15.67:0/3927552021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f901006adc0 0x7f9010071be0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f90100afab0 tx=0x7f900800b330 comp rx=0 tx=0).stop 2023-10-14T11:24:50.697 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 -- 172.21.15.67:0/3927552021 shutdown_connections 2023-10-14T11:24:50.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 --2- 172.21.15.67:0/3927552021 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f901006adc0 0x7f9010071be0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 --2- 172.21.15.67:0/3927552021 >> v2:172.21.15.72:3300/0 conn(0x7f90100c5be0 0x7f901006a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 -- 172.21.15.67:0/3927552021 >> 172.21.15.67:0/3927552021 conn(0x7f90100d0440 msgr2=0x7f90100d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:50.698 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.687+0000 7f9014e4a700 1 -- 172.21.15.67:0/3927552021 shutdown_connections 2023-10-14T11:24:50.699 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.688+0000 7f9014e4a700 1 -- 172.21.15.67:0/3927552021 wait complete. 2023-10-14T11:24:50.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.689+0000 7f9014e4a700 1 Processor -- start 2023-10-14T11:24:50.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.689+0000 7f9014e4a700 1 -- start start 2023-10-14T11:24:50.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901006adc0 0x7f90100ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.702 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901015da60 0x7f90100b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901015b550 con 0x7f90100c5be0 2023-10-14T11:24:50.703 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901015b830 con 0x7f901015da60 2023-10-14T11:24:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f9014e4a700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901015bb10 con 0x7f901006adc0 2023-10-14T11:24:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.704 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43614/0 (socket says 172.21.15.67:43614) 2023-10-14T11:24:50.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 -- 172.21.15.67:0/2144569392 learned_addr learned my addr 172.21.15.67:0/2144569392 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:24:50.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900e59c700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901006adc0 0x7f90100ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900ed9d700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901015da60 0x7f90100b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.705 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 -- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901006adc0 msgr2=0x7f90100ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901006adc0 0x7f90100ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 -- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901015da60 msgr2=0x7f90100b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901015da60 0x7f90100b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.706 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 -- 172.21.15.67:0/2144569392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008009a70 con 0x7f90100c5be0 2023-10-14T11:24:50.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f900dd9b700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f900000c7f0 tx=0x7f900000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:50.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.690+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000004230 con 0x7f90100c5be0 2023-10-14T11:24:50.707 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.691+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9000004390 con 0x7f90100c5be0 2023-10-14T11:24:50.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.691+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90000036a0 con 0x7f90100c5be0 2023-10-14T11:24:50.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.691+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901015bdf0 con 0x7f90100c5be0 2023-10-14T11:24:50.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.691+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901015e570 con 0x7f90100c5be0 2023-10-14T11:24:50.708 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.692+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901004ebb0 con 0x7f90100c5be0 2023-10-14T11:24:50.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.692+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9000003800 con 0x7f90100c5be0 2023-10-14T11:24:50.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.692+0000 7f8ffeffd700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 0x7f8ff006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:24:50.709 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.692+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9000089200 con 0x7f90100c5be0 2023-10-14T11:24:50.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.693+0000 7f900e59c700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 0x7f8ff006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:24:50.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.693+0000 7f900e59c700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 0x7f8ff006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9004007fd0 tx=0x7f9004007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:24:50.710 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.697+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9000054280 con 0x7f90100c5be0 2023-10-14T11:24:50.898 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.896+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f901015b9a0 con 0x7f8ff006af00 2023-10-14T11:24:50.907 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.905+0000 7f8ffeffd700 1 -- 172.21.15.67:0/2144569392 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289490 (secure 0 0 0) 0x7f901015b9a0 con 0x7f8ff006af00 2023-10-14T11:24:50.911 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:24:50.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 msgr2=0x7f8ff006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 0x7f8ff006d3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9004007fd0 tx=0x7f9004007de0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.914 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 msgr2=0x7f901015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:24:50.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f900000c7f0 tx=0x7f900000cb00 comp rx=0 tx=0).stop 2023-10-14T11:24:50.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 shutdown_connections 2023-10-14T11:24:50.915 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f901015da60 0x7f90100b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f901006adc0 0x7f90100ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f8ff006af00 0x7f8ff006d3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 --2- 172.21.15.67:0/2144569392 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f90100c5be0 0x7f901015e030 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:24:50.916 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 >> 172.21.15.67:0/2144569392 conn(0x7f90100d0440 msgr2=0x7f901006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:24:50.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 shutdown_connections 2023-10-14T11:24:50.917 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:24:50.908+0000 7f9014e4a700 1 -- 172.21.15.67:0/2144569392 wait complete. 2023-10-14T11:24:50.917 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:24:50.923 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-10-14T11:24:50.429440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003550"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.618119+0000","last_change":"2023-10-14T11:24:22.618189+0000","last_active":"2023-10-14T11:24:22.618119+0000","last_peered":"2023-10-14T11:24:22.618119+0000","last_clean":"2023-10-14T11:24:22.618119+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:24:22.618119+0000","last_undegraded":"2023-10-14T11:24:22.618119+0000","last_fullsized":"2023-10-14T11:24:22.618119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.618001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:30.049607+0000","scrub_duration":0.00161269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467473+0000","last_change":"2023-10-14T11:23:54.857043+0000","last_active":"2023-10-14T11:23:56.467473+0000","last_peered":"2023-10-14T11:23:56.467473+0000","last_clean":"2023-10-14T11:23:56.467473+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:23:56.467473+0000","last_undegraded":"2023-10-14T11:23:56.467473+0000","last_fullsized":"2023-10-14T11:23:56.467473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605488+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605488+0000","last_peered":"2023-10-14T11:23:57.605488+0000","last_clean":"2023-10-14T11:23:57.605488+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605488+0000","last_undegraded":"2023-10-14T11:23:57.605488+0000","last_fullsized":"2023-10-14T11:23:57.605488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:23.043768+0000","last_change":"2023-10-14T11:24:23.043816+0000","last_active":"2023-10-14T11:24:23.043768+0000","last_peered":"2023-10-14T11:24:23.043768+0000","last_clean":"2023-10-14T11:24:23.043768+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:24:23.043768+0000","last_undegraded":"2023-10-14T11:24:23.043768+0000","last_fullsized":"2023-10-14T11:24:23.043768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_clean_scrub_stamp":"2023-10-14T11:24:23.043656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:35.724772+0000","scrub_duration":0.0018187660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.840180+0000","last_change":"2023-10-14T11:24:30.840272+0000","last_active":"2023-10-14T11:24:30.840180+0000","last_peered":"2023-10-14T11:24:30.840180+0000","last_clean":"2023-10-14T11:24:30.840180+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:24:30.840180+0000","last_undegraded":"2023-10-14T11:24:30.840180+0000","last_fullsized":"2023-10-14T11:24:30.840180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.840084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:55.609420+0000","scrub_duration":0.0012728209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467380+0000","last_change":"2023-10-14T11:23:54.853971+0000","last_active":"2023-10-14T11:23:56.467380+0000","last_peered":"2023-10-14T11:23:56.467380+0000","last_clean":"2023-10-14T11:23:56.467380+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:23:56.467380+0000","last_undegraded":"2023-10-14T11:23:56.467380+0000","last_fullsized":"2023-10-14T11:23:56.467380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.318224+0000","last_change":"2023-10-14T11:24:22.318269+0000","last_active":"2023-10-14T11:24:22.318224+0000","last_peered":"2023-10-14T11:24:22.318224+0000","last_clean":"2023-10-14T11:24:22.318224+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:24:22.318224+0000","last_undegraded":"2023-10-14T11:24:22.318224+0000","last_fullsized":"2023-10-14T11:24:22.318224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.318112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:23.265011+0000","scrub_duration":0.0015173540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:37.217234+0000","last_change":"2023-10-14T11:24:37.217302+0000","last_active":"2023-10-14T11:24:37.217234+0000","last_peered":"2023-10-14T11:24:37.217234+0000","last_clean":"2023-10-14T11:24:37.217234+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:24:37.217234+0000","last_undegraded":"2023-10-14T11:24:37.217234+0000","last_fullsized":"2023-10-14T11:24:37.217234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_clean_scrub_stamp":"2023-10-14T11:24:37.217072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:25.692049+0000","scrub_duration":0.001949898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:38.111581+0000","last_change":"2023-10-14T11:24:38.111626+0000","last_active":"2023-10-14T11:24:38.111581+0000","last_peered":"2023-10-14T11:24:38.111581+0000","last_clean":"2023-10-14T11:24:38.111581+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:24:38.111581+0000","last_undegraded":"2023-10-14T11:24:38.111581+0000","last_fullsized":"2023-10-14T11:24:38.111581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_clean_scrub_stamp":"2023-10-14T11:24:38.111461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:13.964177+0000","scrub_duration":0.0022767479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.962977+0000","last_change":"2023-10-14T11:24:35.963056+0000","last_active":"2023-10-14T11:24:35.962977+0000","last_peered":"2023-10-14T11:24:35.962977+0000","last_clean":"2023-10-14T11:24:35.962977+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:24:35.962977+0000","last_undegraded":"2023-10-14T11:24:35.962977+0000","last_fullsized":"2023-10-14T11:24:35.962977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.962819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:08.610979+0000","scrub_duration":0.0016532439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:46.282432+0000","last_change":"2023-10-14T11:24:46.282500+0000","last_active":"2023-10-14T11:24:46.282432+0000","last_peered":"2023-10-14T11:24:46.282432+0000","last_clean":"2023-10-14T11:24:46.282432+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:24:46.282432+0000","last_undegraded":"2023-10-14T11:24:46.282432+0000","last_fullsized":"2023-10-14T11:24:46.282432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_clean_scrub_stamp":"2023-10-14T11:24:46.282310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.824008+0000","scrub_duration":0.0019801269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605409+0000","last_change":"2023-10-14T11:23:54.855341+0000","last_active":"2023-10-14T11:23:57.605409+0000","last_peered":"2023-10-14T11:23:57.605409+0000","last_clean":"2023-10-14T11:23:57.605409+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:23:57.605409+0000","last_undegraded":"2023-10-14T11:23:57.605409+0000","last_fullsized":"2023-10-14T11:23:57.605409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.652454+0000","last_change":"2023-10-14T11:24:12.652527+0000","last_active":"2023-10-14T11:24:12.652454+0000","last_peered":"2023-10-14T11:24:12.652454+0000","last_clean":"2023-10-14T11:24:12.652454+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:24:12.652454+0000","last_undegraded":"2023-10-14T11:24:12.652454+0000","last_fullsized":"2023-10-14T11:24:12.652454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.652307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:57.451092+0000","scrub_duration":0.0018306030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.160848+0000","last_change":"2023-10-14T11:24:34.160901+0000","last_active":"2023-10-14T11:24:34.160848+0000","last_peered":"2023-10-14T11:24:34.160848+0000","last_clean":"2023-10-14T11:24:34.160848+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:24:34.160848+0000","last_undegraded":"2023-10-14T11:24:34.160848+0000","last_fullsized":"2023-10-14T11:24:34.160848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.160718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.013434+0000","scrub_duration":0.001735412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605427+0000","last_change":"2023-10-14T11:23:54.855992+0000","last_active":"2023-10-14T11:23:57.605427+0000","last_peered":"2023-10-14T11:23:57.605427+0000","last_clean":"2023-10-14T11:23:57.605427+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:23:57.605427+0000","last_undegraded":"2023-10-14T11:23:57.605427+0000","last_fullsized":"2023-10-14T11:23:57.605427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.280516+0000","last_change":"2023-10-14T11:24:41.280574+0000","last_active":"2023-10-14T11:24:41.280516+0000","last_peered":"2023-10-14T11:24:41.280516+0000","last_clean":"2023-10-14T11:24:41.280516+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:24:41.280516+0000","last_undegraded":"2023-10-14T11:24:41.280516+0000","last_fullsized":"2023-10-14T11:24:41.280516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.280409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:19.511351+0000","scrub_duration":0.0022952070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881896+0000","last_change":"2023-10-14T11:23:54.857766+0000","last_active":"2023-10-14T11:23:57.881896+0000","last_peered":"2023-10-14T11:23:57.881896+0000","last_clean":"2023-10-14T11:23:57.881896+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:23:57.881896+0000","last_undegraded":"2023-10-14T11:23:57.881896+0000","last_fullsized":"2023-10-14T11:23:57.881896+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467461+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:56.467461+0000","last_peered":"2023-10-14T11:23:56.467461+0000","last_clean":"2023-10-14T11:23:56.467461+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:56.467461+0000","last_undegraded":"2023-10-14T11:23:56.467461+0000","last_fullsized":"2023-10-14T11:23:56.467461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467438+0000","last_change":"2023-10-14T11:23:54.850963+0000","last_active":"2023-10-14T11:23:56.467438+0000","last_peered":"2023-10-14T11:23:56.467438+0000","last_clean":"2023-10-14T11:23:56.467438+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:23:56.467438+0000","last_undegraded":"2023-10-14T11:23:56.467438+0000","last_fullsized":"2023-10-14T11:23:56.467438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.818675+0000","last_change":"2023-10-14T11:24:31.818741+0000","last_active":"2023-10-14T11:24:31.818675+0000","last_peered":"2023-10-14T11:24:31.818675+0000","last_clean":"2023-10-14T11:24:31.818675+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:24:31.818675+0000","last_undegraded":"2023-10-14T11:24:31.818675+0000","last_fullsized":"2023-10-14T11:24:31.818675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.818485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:03.752400+0000","scrub_duration":0.0019508419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:29.933981+0000","last_change":"2023-10-14T11:24:29.934042+0000","last_active":"2023-10-14T11:24:29.933981+0000","last_peered":"2023-10-14T11:24:29.933981+0000","last_clean":"2023-10-14T11:24:29.933981+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:24:29.933981+0000","last_undegraded":"2023-10-14T11:24:29.933981+0000","last_fullsized":"2023-10-14T11:24:29.933981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_clean_scrub_stamp":"2023-10-14T11:24:29.933851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:12.764047+0000","scrub_duration":0.0021874860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.882055+0000","last_change":"2023-10-14T11:23:54.857195+0000","last_active":"2023-10-14T11:23:57.882055+0000","last_peered":"2023-10-14T11:23:57.882055+0000","last_clean":"2023-10-14T11:23:57.882055+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:23:57.882055+0000","last_undegraded":"2023-10-14T11:23:57.882055+0000","last_fullsized":"2023-10-14T11:23:57.882055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.380454+0000","last_change":"2023-10-14T11:24:17.380528+0000","last_active":"2023-10-14T11:24:17.380454+0000","last_peered":"2023-10-14T11:24:17.380454+0000","last_clean":"2023-10-14T11:24:17.380454+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:24:17.380454+0000","last_undegraded":"2023-10-14T11:24:17.380454+0000","last_fullsized":"2023-10-14T11:24:17.380454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.380311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:49.314225+0000","scrub_duration":0.0020088469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.649868+0000","last_change":"2023-10-14T11:24:25.649924+0000","last_active":"2023-10-14T11:24:25.649868+0000","last_peered":"2023-10-14T11:24:25.649868+0000","last_clean":"2023-10-14T11:24:25.649868+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:24:25.649868+0000","last_undegraded":"2023-10-14T11:24:25.649868+0000","last_fullsized":"2023-10-14T11:24:25.649868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.649757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:50.342876+0000","scrub_duration":0.001768936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.032513+0000","last_change":"2023-10-14T11:24:24.032590+0000","last_active":"2023-10-14T11:24:24.032513+0000","last_peered":"2023-10-14T11:24:24.032513+0000","last_clean":"2023-10-14T11:24:24.032513+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:24:24.032513+0000","last_undegraded":"2023-10-14T11:24:24.032513+0000","last_fullsized":"2023-10-14T11:24:24.032513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.032364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:49.045417+0000","scrub_duration":0.0021628229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467484+0000","last_change":"2023-10-14T11:23:54.852961+0000","last_active":"2023-10-14T11:23:56.467484+0000","last_peered":"2023-10-14T11:23:56.467484+0000","last_clean":"2023-10-14T11:23:56.467484+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:23:56.467484+0000","last_undegraded":"2023-10-14T11:23:56.467484+0000","last_fullsized":"2023-10-14T11:23:56.467484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.050980+0000","last_change":"2023-10-14T11:24:34.051034+0000","last_active":"2023-10-14T11:24:34.050980+0000","last_peered":"2023-10-14T11:24:34.050980+0000","last_clean":"2023-10-14T11:24:34.050980+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:24:34.050980+0000","last_undegraded":"2023-10-14T11:24:34.050980+0000","last_fullsized":"2023-10-14T11:24:34.050980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.050856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:23.081327+0000","scrub_duration":0.0022522530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.610958+0000","last_change":"2023-10-14T11:24:41.611049+0000","last_active":"2023-10-14T11:24:41.610958+0000","last_peered":"2023-10-14T11:24:41.610958+0000","last_clean":"2023-10-14T11:24:41.610958+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:24:41.610958+0000","last_undegraded":"2023-10-14T11:24:41.610958+0000","last_fullsized":"2023-10-14T11:24:41.610958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.610843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:53.135545+0000","scrub_duration":0.0021190929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:28.969856+0000","last_change":"2023-10-14T11:24:28.969918+0000","last_active":"2023-10-14T11:24:28.969856+0000","last_peered":"2023-10-14T11:24:28.969856+0000","last_clean":"2023-10-14T11:24:28.969856+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:24:28.969856+0000","last_undegraded":"2023-10-14T11:24:28.969856+0000","last_fullsized":"2023-10-14T11:24:28.969856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_clean_scrub_stamp":"2023-10-14T11:24:28.969745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:57.115286+0000","scrub_duration":0.0020373919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.293416+0000","last_change":"2023-10-14T11:24:35.293463+0000","last_active":"2023-10-14T11:24:35.293416+0000","last_peered":"2023-10-14T11:24:35.293416+0000","last_clean":"2023-10-14T11:24:35.293416+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:24:35.293416+0000","last_undegraded":"2023-10-14T11:24:35.293416+0000","last_fullsized":"2023-10-14T11:24:35.293416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.293296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:24.323767+0000","scrub_duration":0.0014562679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.612889+0000","last_change":"2023-10-14T11:24:19.612977+0000","last_active":"2023-10-14T11:24:19.612889+0000","last_peered":"2023-10-14T11:24:19.612889+0000","last_clean":"2023-10-14T11:24:19.612889+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:24:19.612889+0000","last_undegraded":"2023-10-14T11:24:19.612889+0000","last_fullsized":"2023-10-14T11:24:19.612889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.612775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:28.923551+0000","scrub_duration":0.0020682040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.353591+0000","last_change":"2023-10-14T11:24:18.353635+0000","last_active":"2023-10-14T11:24:18.353591+0000","last_peered":"2023-10-14T11:24:18.353591+0000","last_clean":"2023-10-14T11:24:18.353591+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:24:18.353591+0000","last_undegraded":"2023-10-14T11:24:18.353591+0000","last_fullsized":"2023-10-14T11:24:18.353591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.353458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:12.119177+0000","scrub_duration":0.001475496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.371536+0000","last_change":"2023-10-14T11:24:26.371583+0000","last_active":"2023-10-14T11:24:26.371536+0000","last_peered":"2023-10-14T11:24:26.371536+0000","last_clean":"2023-10-14T11:24:26.371536+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:24:26.371536+0000","last_undegraded":"2023-10-14T11:24:26.371536+0000","last_fullsized":"2023-10-14T11:24:26.371536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.371421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:10.031597+0000","scrub_duration":0.002261239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.572146+0000","last_change":"2023-10-14T11:24:12.572201+0000","last_active":"2023-10-14T11:24:12.572146+0000","last_peered":"2023-10-14T11:24:12.572146+0000","last_clean":"2023-10-14T11:24:12.572146+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:24:12.572146+0000","last_undegraded":"2023-10-14T11:24:12.572146+0000","last_fullsized":"2023-10-14T11:24:12.572146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.572029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:05.536861+0000","scrub_duration":0.0021884140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.588810+0000","last_change":"2023-10-14T11:24:20.588873+0000","last_active":"2023-10-14T11:24:20.588810+0000","last_peered":"2023-10-14T11:24:20.588810+0000","last_clean":"2023-10-14T11:24:20.588810+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:24:20.588810+0000","last_undegraded":"2023-10-14T11:24:20.588810+0000","last_fullsized":"2023-10-14T11:24:20.588810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.588675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:49.622214+0000","scrub_duration":0.0016745919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.359903+0000","last_change":"2023-10-14T11:24:16.359975+0000","last_active":"2023-10-14T11:24:16.359903+0000","last_peered":"2023-10-14T11:24:16.359903+0000","last_clean":"2023-10-14T11:24:16.359903+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:24:16.359903+0000","last_undegraded":"2023-10-14T11:24:16.359903+0000","last_fullsized":"2023-10-14T11:24:16.359903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.359793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.129129+0000","scrub_duration":0.002300818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881700+0000","last_change":"2023-10-14T11:23:54.858417+0000","last_active":"2023-10-14T11:23:57.881700+0000","last_peered":"2023-10-14T11:23:57.881700+0000","last_clean":"2023-10-14T11:23:57.881700+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:23:57.881700+0000","last_undegraded":"2023-10-14T11:23:57.881700+0000","last_fullsized":"2023-10-14T11:23:57.881700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.224194+0000","last_change":"2023-10-14T11:24:25.224252+0000","last_active":"2023-10-14T11:24:25.224194+0000","last_peered":"2023-10-14T11:24:25.224194+0000","last_clean":"2023-10-14T11:24:25.224194+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:24:25.224194+0000","last_undegraded":"2023-10-14T11:24:25.224194+0000","last_fullsized":"2023-10-14T11:24:25.224194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.224080+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:08.054276+0000","scrub_duration":0.0030700860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.938216+0000","last_change":"2023-10-14T11:24:30.938255+0000","last_active":"2023-10-14T11:24:30.938216+0000","last_peered":"2023-10-14T11:24:30.938216+0000","last_clean":"2023-10-14T11:24:30.938216+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:24:30.938216+0000","last_undegraded":"2023-10-14T11:24:30.938216+0000","last_fullsized":"2023-10-14T11:24:30.938216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.938126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.687486+0000","scrub_duration":0.0018420349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.657769+0000","last_change":"2023-10-14T11:24:10.657818+0000","last_active":"2023-10-14T11:24:10.657769+0000","last_peered":"2023-10-14T11:24:10.657769+0000","last_clean":"2023-10-14T11:24:10.657769+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:24:10.657769+0000","last_undegraded":"2023-10-14T11:24:10.657769+0000","last_fullsized":"2023-10-14T11:24:10.657769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.657669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:51.690631+0000","scrub_duration":0.0017120919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881530+0000","last_change":"2023-10-14T11:23:54.861862+0000","last_active":"2023-10-14T11:23:57.881530+0000","last_peered":"2023-10-14T11:23:57.881530+0000","last_clean":"2023-10-14T11:23:57.881530+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:23:57.881530+0000","last_undegraded":"2023-10-14T11:23:57.881530+0000","last_fullsized":"2023-10-14T11:23:57.881530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.955178+0000","last_change":"2023-10-14T11:24:22.955233+0000","last_active":"2023-10-14T11:24:22.955178+0000","last_peered":"2023-10-14T11:24:22.955178+0000","last_clean":"2023-10-14T11:24:22.955178+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:24:22.955178+0000","last_undegraded":"2023-10-14T11:24:22.955178+0000","last_fullsized":"2023-10-14T11:24:22.955178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.955060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:16.720779+0000","scrub_duration":0.0019597210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605637+0000","last_change":"2023-10-14T11:23:54.867012+0000","last_active":"2023-10-14T11:23:57.605637+0000","last_peered":"2023-10-14T11:23:57.605637+0000","last_clean":"2023-10-14T11:23:57.605637+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:23:57.605637+0000","last_undegraded":"2023-10-14T11:23:57.605637+0000","last_fullsized":"2023-10-14T11:23:57.605637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.031156+0000","last_change":"2023-10-14T11:24:19.031223+0000","last_active":"2023-10-14T11:24:19.031156+0000","last_peered":"2023-10-14T11:24:19.031156+0000","last_clean":"2023-10-14T11:24:19.031156+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:24:19.031156+0000","last_undegraded":"2023-10-14T11:24:19.031156+0000","last_fullsized":"2023-10-14T11:24:19.031156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.031043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:14.404949+0000","scrub_duration":0.002047484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.938331+0000","last_change":"2023-10-14T11:24:31.938378+0000","last_active":"2023-10-14T11:24:31.938331+0000","last_peered":"2023-10-14T11:24:31.938331+0000","last_clean":"2023-10-14T11:24:31.938331+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:24:31.938331+0000","last_undegraded":"2023-10-14T11:24:31.938331+0000","last_fullsized":"2023-10-14T11:24:31.938331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.938227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:52.622754+0000","scrub_duration":0.00144428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.033528+0000","last_change":"2023-10-14T11:24:16.033579+0000","last_active":"2023-10-14T11:24:16.033528+0000","last_peered":"2023-10-14T11:24:16.033528+0000","last_clean":"2023-10-14T11:24:16.033528+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:24:16.033528+0000","last_undegraded":"2023-10-14T11:24:16.033528+0000","last_fullsized":"2023-10-14T11:24:16.033528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.033420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:16.980319+0000","scrub_duration":0.0015776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.007336+0000","last_change":"2023-10-14T11:24:35.007399+0000","last_active":"2023-10-14T11:24:35.007336+0000","last_peered":"2023-10-14T11:24:35.007336+0000","last_clean":"2023-10-14T11:24:35.007336+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:24:35.007336+0000","last_undegraded":"2023-10-14T11:24:35.007336+0000","last_fullsized":"2023-10-14T11:24:35.007336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.007224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:23.482201+0000","scrub_duration":0.0022040940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.918317+0000","last_change":"2023-10-14T11:24:12.918415+0000","last_active":"2023-10-14T11:24:12.918317+0000","last_peered":"2023-10-14T11:24:12.918317+0000","last_clean":"2023-10-14T11:24:12.918317+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:24:12.918317+0000","last_undegraded":"2023-10-14T11:24:12.918317+0000","last_fullsized":"2023-10-14T11:24:12.918317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.918195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:41.951734+0000","scrub_duration":0.001509102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605639+0000","last_change":"2023-10-14T11:23:54.863258+0000","last_active":"2023-10-14T11:23:57.605639+0000","last_peered":"2023-10-14T11:23:57.605639+0000","last_clean":"2023-10-14T11:23:57.605639+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:23:57.605639+0000","last_undegraded":"2023-10-14T11:23:57.605639+0000","last_fullsized":"2023-10-14T11:23:57.605639+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.117423+0000","last_change":"2023-10-14T11:24:20.117501+0000","last_active":"2023-10-14T11:24:20.117423+0000","last_peered":"2023-10-14T11:24:20.117423+0000","last_clean":"2023-10-14T11:24:20.117423+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:24:20.117423+0000","last_undegraded":"2023-10-14T11:24:20.117423+0000","last_fullsized":"2023-10-14T11:24:20.117423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.117283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:09.147754+0000","scrub_duration":0.002212463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467504+0000","last_change":"2023-10-14T11:23:54.857180+0000","last_active":"2023-10-14T11:23:56.467504+0000","last_peered":"2023-10-14T11:23:56.467504+0000","last_clean":"2023-10-14T11:23:56.467504+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:23:56.467504+0000","last_undegraded":"2023-10-14T11:23:56.467504+0000","last_fullsized":"2023-10-14T11:23:56.467504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.367700+0000","last_change":"2023-10-14T11:24:15.367749+0000","last_active":"2023-10-14T11:24:15.367700+0000","last_peered":"2023-10-14T11:24:15.367700+0000","last_clean":"2023-10-14T11:24:15.367700+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:24:15.367700+0000","last_undegraded":"2023-10-14T11:24:15.367700+0000","last_fullsized":"2023-10-14T11:24:15.367700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.367586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:36.189165+0000","scrub_duration":0.001682048,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.001748+0000","last_change":"2023-10-14T11:24:10.001813+0000","last_active":"2023-10-14T11:24:10.001748+0000","last_peered":"2023-10-14T11:24:10.001748+0000","last_clean":"2023-10-14T11:24:10.001748+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:24:10.001748+0000","last_undegraded":"2023-10-14T11:24:10.001748+0000","last_fullsized":"2023-10-14T11:24:10.001748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.001627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:51.478987+0000","scrub_duration":0.001776112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.629817+0000","last_change":"2023-10-14T11:24:22.629870+0000","last_active":"2023-10-14T11:24:22.629817+0000","last_peered":"2023-10-14T11:24:22.629817+0000","last_clean":"2023-10-14T11:24:22.629817+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:24:22.629817+0000","last_undegraded":"2023-10-14T11:24:22.629817+0000","last_fullsized":"2023-10-14T11:24:22.629817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.629697+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:04.107057+0000","scrub_duration":0.0021629869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605584+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605584+0000","last_peered":"2023-10-14T11:23:57.605584+0000","last_clean":"2023-10-14T11:23:57.605584+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605584+0000","last_undegraded":"2023-10-14T11:23:57.605584+0000","last_fullsized":"2023-10-14T11:23:57.605584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:14.989113+0000","last_change":"2023-10-14T11:24:14.989170+0000","last_active":"2023-10-14T11:24:14.989113+0000","last_peered":"2023-10-14T11:24:14.989113+0000","last_clean":"2023-10-14T11:24:14.989113+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:24:14.989113+0000","last_undegraded":"2023-10-14T11:24:14.989113+0000","last_fullsized":"2023-10-14T11:24:14.989113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_clean_scrub_stamp":"2023-10-14T11:24:14.988999+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:08.754718+0000","scrub_duration":0.0030364979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.174066+0000","last_change":"2023-10-14T11:24:18.174117+0000","last_active":"2023-10-14T11:24:18.174066+0000","last_peered":"2023-10-14T11:24:18.174066+0000","last_clean":"2023-10-14T11:24:18.174066+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:24:18.174066+0000","last_undegraded":"2023-10-14T11:24:18.174066+0000","last_fullsized":"2023-10-14T11:24:18.174066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.173944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:01.834121+0000","scrub_duration":0.0025641790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.947992+0000","last_change":"2023-10-14T11:24:13.948045+0000","last_active":"2023-10-14T11:24:13.947992+0000","last_peered":"2023-10-14T11:24:13.947992+0000","last_clean":"2023-10-14T11:24:13.947992+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:24:13.947992+0000","last_undegraded":"2023-10-14T11:24:13.947992+0000","last_fullsized":"2023-10-14T11:24:13.947992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.947888+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:11.579179+0000","scrub_duration":0.002298937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:45.115302+0000","last_change":"2023-10-14T11:24:45.115354+0000","last_active":"2023-10-14T11:24:45.115302+0000","last_peered":"2023-10-14T11:24:45.115302+0000","last_clean":"2023-10-14T11:24:45.115302+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:24:45.115302+0000","last_undegraded":"2023-10-14T11:24:45.115302+0000","last_fullsized":"2023-10-14T11:24:45.115302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_clean_scrub_stamp":"2023-10-14T11:24:45.115192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:41.051192+0000","scrub_duration":0.001751362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.193107+0000","last_change":"2023-10-14T11:24:15.193158+0000","last_active":"2023-10-14T11:24:15.193107+0000","last_peered":"2023-10-14T11:24:15.193107+0000","last_clean":"2023-10-14T11:24:15.193107+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:24:15.193107+0000","last_undegraded":"2023-10-14T11:24:15.193107+0000","last_fullsized":"2023-10-14T11:24:15.193107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.193011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:15.570002+0000","scrub_duration":0.0020719250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881689+0000","last_change":"2023-10-14T11:23:54.859903+0000","last_active":"2023-10-14T11:23:57.881689+0000","last_peered":"2023-10-14T11:23:57.881689+0000","last_clean":"2023-10-14T11:23:57.881689+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:23:57.881689+0000","last_undegraded":"2023-10-14T11:23:57.881689+0000","last_fullsized":"2023-10-14T11:23:57.881689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.075214+0000","last_change":"2023-10-14T11:24:18.075260+0000","last_active":"2023-10-14T11:24:18.075214+0000","last_peered":"2023-10-14T11:24:18.075214+0000","last_clean":"2023-10-14T11:24:18.075214+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:24:18.075214+0000","last_undegraded":"2023-10-14T11:24:18.075214+0000","last_fullsized":"2023-10-14T11:24:18.075214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.075105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:57:07.333526+0000","scrub_duration":0.0020020939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.600778+0000","last_change":"2023-10-14T11:24:18.600826+0000","last_active":"2023-10-14T11:24:18.600778+0000","last_peered":"2023-10-14T11:24:18.600778+0000","last_clean":"2023-10-14T11:24:18.600778+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:24:18.600778+0000","last_undegraded":"2023-10-14T11:24:18.600778+0000","last_fullsized":"2023-10-14T11:24:18.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.600643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:39.422221+0000","scrub_duration":0.001627075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.039119+0000","last_change":"2023-10-14T11:24:17.039213+0000","last_active":"2023-10-14T11:24:17.039119+0000","last_peered":"2023-10-14T11:24:17.039119+0000","last_clean":"2023-10-14T11:24:17.039119+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:24:17.039119+0000","last_undegraded":"2023-10-14T11:24:17.039119+0000","last_fullsized":"2023-10-14T11:24:17.039119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.038941+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:35.598811+0000","scrub_duration":0.0024319699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:27.919753+0000","last_change":"2023-10-14T11:24:27.919799+0000","last_active":"2023-10-14T11:24:27.919753+0000","last_peered":"2023-10-14T11:24:27.919753+0000","last_clean":"2023-10-14T11:24:27.919753+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:24:27.919753+0000","last_undegraded":"2023-10-14T11:24:27.919753+0000","last_fullsized":"2023-10-14T11:24:27.919753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_clean_scrub_stamp":"2023-10-14T11:24:27.919641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:39.444343+0000","scrub_duration":0.001583232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:07.216148+0000","last_change":"2023-10-14T11:24:07.216215+0000","last_active":"2023-10-14T11:24:07.216148+0000","last_peered":"2023-10-14T11:24:07.216148+0000","last_clean":"2023-10-14T11:24:07.216148+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:24:07.216148+0000","last_undegraded":"2023-10-14T11:24:07.216148+0000","last_fullsized":"2023-10-14T11:24:07.216148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_clean_scrub_stamp":"2023-10-14T11:24:07.216014+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:28.037593+0000","scrub_duration":0.001805564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605730+0000","last_change":"2023-10-14T11:23:54.859217+0000","last_active":"2023-10-14T11:23:57.605730+0000","last_peered":"2023-10-14T11:23:57.605730+0000","last_clean":"2023-10-14T11:23:57.605730+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:23:57.605730+0000","last_undegraded":"2023-10-14T11:23:57.605730+0000","last_fullsized":"2023-10-14T11:23:57.605730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.928168+0000","last_change":"2023-10-14T11:24:26.928221+0000","last_active":"2023-10-14T11:24:26.928168+0000","last_peered":"2023-10-14T11:24:26.928168+0000","last_clean":"2023-10-14T11:24:26.928168+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:24:26.928168+0000","last_undegraded":"2023-10-14T11:24:26.928168+0000","last_fullsized":"2023-10-14T11:24:26.928168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.928047+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:45.487917+0000","scrub_duration":0.002943017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:36.993836+0000","last_change":"2023-10-14T11:24:36.993895+0000","last_active":"2023-10-14T11:24:36.993836+0000","last_peered":"2023-10-14T11:24:36.993836+0000","last_clean":"2023-10-14T11:24:36.993836+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:24:36.993836+0000","last_undegraded":"2023-10-14T11:24:36.993836+0000","last_fullsized":"2023-10-14T11:24:36.993836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_clean_scrub_stamp":"2023-10-14T11:24:36.993722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:40.645496+0000","scrub_duration":0.0019673289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.964012+0000","last_change":"2023-10-14T11:24:11.964066+0000","last_active":"2023-10-14T11:24:11.964012+0000","last_peered":"2023-10-14T11:24:11.964012+0000","last_clean":"2023-10-14T11:24:11.964012+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:24:11.964012+0000","last_undegraded":"2023-10-14T11:24:11.964012+0000","last_fullsized":"2023-10-14T11:24:11.964012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.963898+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:00.000285+0000","scrub_duration":0.0025292790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.776905+0000","last_change":"2023-10-14T11:24:32.776965+0000","last_active":"2023-10-14T11:24:32.776905+0000","last_peered":"2023-10-14T11:24:32.776905+0000","last_clean":"2023-10-14T11:24:32.776905+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:24:32.776905+0000","last_undegraded":"2023-10-14T11:24:32.776905+0000","last_fullsized":"2023-10-14T11:24:32.776905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.776767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:30.408058+0000","scrub_duration":0.0019839609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.997169+0000","last_change":"2023-10-14T11:24:24.997231+0000","last_active":"2023-10-14T11:24:24.997169+0000","last_peered":"2023-10-14T11:24:24.997169+0000","last_clean":"2023-10-14T11:24:24.997169+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:24:24.997169+0000","last_undegraded":"2023-10-14T11:24:24.997169+0000","last_fullsized":"2023-10-14T11:24:24.997169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.997051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:25.943950+0000","scrub_duration":0.0018370400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.658392+0000","last_change":"2023-10-14T11:24:16.658443+0000","last_active":"2023-10-14T11:24:16.658392+0000","last_peered":"2023-10-14T11:24:16.658392+0000","last_clean":"2023-10-14T11:24:16.658392+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:24:16.658392+0000","last_undegraded":"2023-10-14T11:24:16.658392+0000","last_fullsized":"2023-10-14T11:24:16.658392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.658265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:09.623097+0000","scrub_duration":0.002318826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:06.515192+0000","last_change":"2023-10-14T11:24:06.515272+0000","last_active":"2023-10-14T11:24:06.515192+0000","last_peered":"2023-10-14T11:24:06.515192+0000","last_clean":"2023-10-14T11:24:06.515192+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:24:06.515192+0000","last_undegraded":"2023-10-14T11:24:06.515192+0000","last_fullsized":"2023-10-14T11:24:06.515192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_clean_scrub_stamp":"2023-10-14T11:24:06.515039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:17.317480+0000","scrub_duration":0.001648042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.679270+0000","last_change":"2023-10-14T11:24:20.679372+0000","last_active":"2023-10-14T11:24:20.679270+0000","last_peered":"2023-10-14T11:24:20.679270+0000","last_clean":"2023-10-14T11:24:20.679270+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:24:20.679270+0000","last_undegraded":"2023-10-14T11:24:20.679270+0000","last_fullsized":"2023-10-14T11:24:20.679270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.679137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:25.181756+0000","scrub_duration":0.0016657740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.623905+0000","last_change":"2023-10-14T11:24:16.623954+0000","last_active":"2023-10-14T11:24:16.623905+0000","last_peered":"2023-10-14T11:24:16.623905+0000","last_clean":"2023-10-14T11:24:16.623905+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:24:16.623905+0000","last_undegraded":"2023-10-14T11:24:16.623905+0000","last_fullsized":"2023-10-14T11:24:16.623905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.623790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:10.423515+0000","scrub_duration":0.0020869059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.646219+0000","last_change":"2023-10-14T11:24:11.646268+0000","last_active":"2023-10-14T11:24:11.646219+0000","last_peered":"2023-10-14T11:24:11.646219+0000","last_clean":"2023-10-14T11:24:11.646219+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:24:11.646219+0000","last_undegraded":"2023-10-14T11:24:11.646219+0000","last_fullsized":"2023-10-14T11:24:11.646219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.646099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:23.978037+0000","scrub_duration":0.001698242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.988120+0000","last_change":"2023-10-14T11:24:17.988172+0000","last_active":"2023-10-14T11:24:17.988120+0000","last_peered":"2023-10-14T11:24:17.988120+0000","last_clean":"2023-10-14T11:24:17.988120+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:24:17.988120+0000","last_undegraded":"2023-10-14T11:24:17.988120+0000","last_fullsized":"2023-10-14T11:24:17.988120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.988015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:59.465375+0000","scrub_duration":0.0020367390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881425+0000","last_change":"2023-10-14T11:23:54.863800+0000","last_active":"2023-10-14T11:23:57.881425+0000","last_peered":"2023-10-14T11:23:57.881425+0000","last_clean":"2023-10-14T11:23:57.881425+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:23:57.881425+0000","last_undegraded":"2023-10-14T11:23:57.881425+0000","last_fullsized":"2023-10-14T11:23:57.881425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.626811+0000","last_change":"2023-10-14T11:24:24.626862+0000","last_active":"2023-10-14T11:24:24.626811+0000","last_peered":"2023-10-14T11:24:24.626811+0000","last_clean":"2023-10-14T11:24:24.626811+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:24:24.626811+0000","last_undegraded":"2023-10-14T11:24:24.626811+0000","last_fullsized":"2023-10-14T11:24:24.626811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.626702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:08.286879+0000","scrub_duration":0.001499691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.826017+0000","last_change":"2023-10-14T11:24:34.826073+0000","last_active":"2023-10-14T11:24:34.826017+0000","last_peered":"2023-10-14T11:24:34.826017+0000","last_clean":"2023-10-14T11:24:34.826017+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:24:34.826017+0000","last_undegraded":"2023-10-14T11:24:34.826017+0000","last_fullsized":"2023-10-14T11:24:34.826017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.825890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:37.040029+0000","scrub_duration":0.001947362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.137672+0000","last_change":"2023-10-14T11:24:12.137759+0000","last_active":"2023-10-14T11:24:12.137672+0000","last_peered":"2023-10-14T11:24:12.137672+0000","last_clean":"2023-10-14T11:24:12.137672+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:24:12.137672+0000","last_undegraded":"2023-10-14T11:24:12.137672+0000","last_fullsized":"2023-10-14T11:24:12.137672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.137511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:19.569117+0000","scrub_duration":0.0022568279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605641+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605641+0000","last_peered":"2023-10-14T11:23:57.605641+0000","last_clean":"2023-10-14T11:23:57.605641+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605641+0000","last_undegraded":"2023-10-14T11:23:57.605641+0000","last_fullsized":"2023-10-14T11:23:57.605641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.379212+0000","last_change":"2023-10-14T11:24:13.379271+0000","last_active":"2023-10-14T11:24:13.379212+0000","last_peered":"2023-10-14T11:24:13.379212+0000","last_clean":"2023-10-14T11:24:13.379212+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:24:13.379212+0000","last_undegraded":"2023-10-14T11:24:13.379212+0000","last_fullsized":"2023-10-14T11:24:13.379212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.379092+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:17.881711+0000","scrub_duration":0.00205668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.349746+0000","last_change":"2023-10-14T11:24:18.349802+0000","last_active":"2023-10-14T11:24:18.349746+0000","last_peered":"2023-10-14T11:24:18.349746+0000","last_clean":"2023-10-14T11:24:18.349746+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:24:18.349746+0000","last_undegraded":"2023-10-14T11:24:18.349746+0000","last_fullsized":"2023-10-14T11:24:18.349746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.349596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:15.980887+0000","scrub_duration":0.0016496950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.201195+0000","last_change":"2023-10-14T11:24:16.201259+0000","last_active":"2023-10-14T11:24:16.201195+0000","last_peered":"2023-10-14T11:24:16.201195+0000","last_clean":"2023-10-14T11:24:16.201195+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:24:16.201195+0000","last_undegraded":"2023-10-14T11:24:16.201195+0000","last_fullsized":"2023-10-14T11:24:16.201195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.201090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:24.787692+0000","scrub_duration":0.0016295120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.661091+0000","last_change":"2023-10-14T11:24:25.661135+0000","last_active":"2023-10-14T11:24:25.661091+0000","last_peered":"2023-10-14T11:24:25.661091+0000","last_clean":"2023-10-14T11:24:25.661091+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:24:25.661091+0000","last_undegraded":"2023-10-14T11:24:25.661091+0000","last_fullsized":"2023-10-14T11:24:25.661091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.660987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:27.875126+0000","scrub_duration":0.0019431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.446770+0000","last_change":"2023-10-14T11:24:10.446815+0000","last_active":"2023-10-14T11:24:10.446770+0000","last_peered":"2023-10-14T11:24:10.446770+0000","last_clean":"2023-10-14T11:24:10.446770+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:24:10.446770+0000","last_undegraded":"2023-10-14T11:24:10.446770+0000","last_fullsized":"2023-10-14T11:24:10.446770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.446679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:49.333800+0000","scrub_duration":0.0018293230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.387752+0000","last_change":"2023-10-14T11:24:20.387801+0000","last_active":"2023-10-14T11:24:20.387752+0000","last_peered":"2023-10-14T11:24:20.387752+0000","last_clean":"2023-10-14T11:24:20.387752+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:24:20.387752+0000","last_undegraded":"2023-10-14T11:24:20.387752+0000","last_fullsized":"2023-10-14T11:24:20.387752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.387627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:28.974229+0000","scrub_duration":0.001943073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:08.171269+0000","last_change":"2023-10-14T11:24:08.171308+0000","last_active":"2023-10-14T11:24:08.171269+0000","last_peered":"2023-10-14T11:24:08.171269+0000","last_clean":"2023-10-14T11:24:08.171269+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:24:08.171269+0000","last_undegraded":"2023-10-14T11:24:08.171269+0000","last_fullsized":"2023-10-14T11:24:08.171269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_clean_scrub_stamp":"2023-10-14T11:24:08.171180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:17.481955+0000","scrub_duration":0.0018328719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.123711+0000","last_change":"2023-10-14T11:24:32.123785+0000","last_active":"2023-10-14T11:24:32.123711+0000","last_peered":"2023-10-14T11:24:32.123711+0000","last_clean":"2023-10-14T11:24:32.123711+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:24:32.123711+0000","last_undegraded":"2023-10-14T11:24:32.123711+0000","last_fullsized":"2023-10-14T11:24:32.123711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.123562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:19.665259+0000","scrub_duration":0.0016330889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.978070+0000","last_change":"2023-10-14T11:24:15.978119+0000","last_active":"2023-10-14T11:24:15.978070+0000","last_peered":"2023-10-14T11:24:15.978070+0000","last_clean":"2023-10-14T11:24:15.978070+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:24:15.978070+0000","last_undegraded":"2023-10-14T11:24:15.978070+0000","last_fullsized":"2023-10-14T11:24:15.978070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.977938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:18.192077+0000","scrub_duration":0.0017069959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:39.082766+0000","last_change":"2023-10-14T11:24:39.082831+0000","last_active":"2023-10-14T11:24:39.082766+0000","last_peered":"2023-10-14T11:24:39.082766+0000","last_clean":"2023-10-14T11:24:39.082766+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:24:39.082766+0000","last_undegraded":"2023-10-14T11:24:39.082766+0000","last_fullsized":"2023-10-14T11:24:39.082766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_clean_scrub_stamp":"2023-10-14T11:24:39.082622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.935204+0000","scrub_duration":0.002294815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.980966+0000","last_change":"2023-10-14T11:24:10.981021+0000","last_active":"2023-10-14T11:24:10.980966+0000","last_peered":"2023-10-14T11:24:10.980966+0000","last_clean":"2023-10-14T11:24:10.980966+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:24:10.980966+0000","last_undegraded":"2023-10-14T11:24:10.980966+0000","last_fullsized":"2023-10-14T11:24:10.980966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.980842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:54.641019+0000","scrub_duration":0.0019702180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.881509+0000","last_change":"2023-10-14T11:23:54.863292+0000","last_active":"2023-10-14T11:23:57.881509+0000","last_peered":"2023-10-14T11:23:57.881509+0000","last_clean":"2023-10-14T11:23:57.881509+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:23:57.881509+0000","last_undegraded":"2023-10-14T11:23:57.881509+0000","last_fullsized":"2023-10-14T11:23:57.881509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.561706+0000","last_change":"2023-10-14T11:24:10.561759+0000","last_active":"2023-10-14T11:24:10.561706+0000","last_peered":"2023-10-14T11:24:10.561706+0000","last_clean":"2023-10-14T11:24:10.561706+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:24:10.561706+0000","last_undegraded":"2023-10-14T11:24:10.561706+0000","last_fullsized":"2023-10-14T11:24:10.561706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.561597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:55.360382+0000","scrub_duration":0.0015897629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":185,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.419258+0000","last_change":"2023-10-14T11:24:11.419316+0000","last_active":"2023-10-14T11:24:11.419258+0000","last_peered":"2023-10-14T11:24:11.419258+0000","last_clean":"2023-10-14T11:24:11.419258+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:24:11.419258+0000","last_undegraded":"2023-10-14T11:24:11.419258+0000","last_fullsized":"2023-10-14T11:24:11.419258+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.419125+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:27.365475+0000","scrub_duration":0.0059804070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.45800000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58099999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.433}]},{"osd":3,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.63},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.504}]},{"osd":5,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.70999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63700000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.502}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46100000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.57799999999999996}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":4.923,"5min":4.923,"15min":4.923},"last":0.314},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":4.9809999999999999,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.375},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":5.3209999999999997,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":5.3600000000000003,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.0250000000000004,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7270000000000003,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":5.4569999999999999,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.665,"5min":5.665,"15min":5.665},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":5.4349999999999996,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.52300000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":5.6399999999999997,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":5.548,"5min":5.548,"15min":5.548},"last":0.72699999999999998}]},{"osd":7,"last update":"Sat Oct 14 11:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.5830000000000002,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6929999999999996,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.65000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.313},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":5.0119999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.0890000000000004,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.374}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.952,"5min":4.952,"15min":4.952},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":5.0510000000000002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.1219999999999999,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.9750000000000001,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.495},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.51700000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.38}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.629},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.57099999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.505},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.52400000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.54700000000000004}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.59499999999999997}]},{"osd":4,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.87}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.753},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.2380000000000004,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.623}]},{"osd":2,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.625,"5min":5.625,"15min":5.625},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.48999999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":3.6349999999999998,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.9820000000000002,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.69399999999999995}]},{"osd":5,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.40799999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.38900000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:23:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.67000000000000004}]},{"osd":1,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.627}]},{"osd":3,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47199999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:23:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:24:50.929 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.930 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.930 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.933 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.934 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.934 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.935 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.935 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.935 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.936 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.936 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.937 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.937 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.938 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.938 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.939 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.939 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.940 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.940 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.941 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.941 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:24:50.941 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T11:25:04.136 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:04.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:10.943 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:25:11.083 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.081+0000 7f0765a23700 1 Processor -- start 2023-10-14T11:25:11.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.081+0000 7f0765a23700 1 -- start start 2023-10-14T11:25:11.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f0765a23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0760162340 0x7f07600d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:11.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f0765a23700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600ce360 con 0x7f0760161ee0 2023-10-14T11:25:11.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f0765a23700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600d00c0 con 0x7f07601610f0 2023-10-14T11:25:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f0765a23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600d03a0 con 0x7f0760162340 2023-10-14T11:25:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f075e7fc700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7f0760161ee0 0x7f07600d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42914/0 (socket says 172.21.15.67:42914) 2023-10-14T11:25:11.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f075e7fc700 1 -- 172.21.15.67:0/3880444235 learned_addr learned my addr 172.21.15.67:0/3880444235 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:25:11.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.082+0000 7f075f7fe700 1 --2- 172.21.15.67:0/3880444235 >> v2:172.21.15.72:3300/0 conn(0x7f0760162340 0x7f07600d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:11.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419235270 0 0) 0x7f07600ce360 con 0x7f0760161ee0 2023-10-14T11:25:11.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 --> v1:172.21.15.67:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f074c0035b0 con 0x7f0760161ee0 2023-10-14T11:25:11.089 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075f7fe700 1 -- 172.21.15.67:0/3880444235 >> v1:172.21.15.72:6789/0 conn(0x7f07601610f0 legacy=0x7f07601617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 <== mon.1 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487072586 0 0) 0x7f07600d00c0 con 0x7f07601610f0 2023-10-14T11:25:11.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075f7fe700 1 -- 172.21.15.67:0/3880444235 >> v1:172.21.15.67:6789/0 conn(0x7f0760161ee0 legacy=0x7f07600d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.090 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075f7fe700 1 -- 172.21.15.67:0/3880444235 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600d0680 con 0x7f0760162340 2023-10-14T11:25:11.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075f7fe700 1 --2- 172.21.15.67:0/3880444235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f07600d1a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0758009d90 tx=0x7f075800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dff85264d018dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:11.091 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 <== mon.1 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800e070 con 0x7f0760162340 2023-10-14T11:25:11.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 <== mon.1 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075800bb20 con 0x7f0760162340 2023-10-14T11:25:11.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.083+0000 7f075dffb700 1 -- 172.21.15.67:0/3880444235 <== mon.1 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075800bed0 con 0x7f0760162340 2023-10-14T11:25:11.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 -- 172.21.15.67:0/3880444235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 msgr2=0x7f07600d1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.092 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 --2- 172.21.15.67:0/3880444235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f07600d1a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0758009d90 tx=0x7f075800b330 comp rx=0 tx=0).stop 2023-10-14T11:25:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 -- 172.21.15.67:0/3880444235 shutdown_connections 2023-10-14T11:25:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 --2- 172.21.15.67:0/3880444235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f07600d1a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.093 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 -- 172.21.15.67:0/3880444235 >> 172.21.15.67:0/3880444235 conn(0x7f076009cab0 msgr2=0x7f07600d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 -- 172.21.15.67:0/3880444235 shutdown_connections 2023-10-14T11:25:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.084+0000 7f0765a23700 1 -- 172.21.15.67:0/3880444235 wait complete. 2023-10-14T11:25:11.094 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.085+0000 7f0765a23700 1 Processor -- start 2023-10-14T11:25:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.085+0000 7f0765a23700 1 -- start start 2023-10-14T11:25:11.097 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 0x7f07600ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f0760157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:11.098 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076015e770 con 0x7f07601610f0 2023-10-14T11:25:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601602d0 con 0x7f0760162340 2023-10-14T11:25:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f0765a23700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600cd170 con 0x7f0760161ee0 2023-10-14T11:25:11.099 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075effd700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43626/0 (socket says 172.21.15.67:43626) 2023-10-14T11:25:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075effd700 1 -- 172.21.15.67:0/338866438 learned_addr learned my addr 172.21.15.67:0/338866438 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:11.100 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075f7fe700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f0760157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075e7fc700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 0x7f07600ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.086+0000 7f075effd700 1 -- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 msgr2=0x7f07600ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.101 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075effd700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 0x7f07600ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075effd700 1 -- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 msgr2=0x7f0760157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075effd700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f0760157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075effd700 1 -- 172.21.15.67:0/338866438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009a70 con 0x7f07601610f0 2023-10-14T11:25:11.102 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075e7fc700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 0x7f07600ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T11:25:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f075effd700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f074800c500 tx=0x7f074800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07480054e0 con 0x7f07601610f0 2023-10-14T11:25:11.103 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07480036d0 con 0x7f07601610f0 2023-10-14T11:25:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07601f7170 con 0x7f07601610f0 2023-10-14T11:25:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748003a80 con 0x7f07601610f0 2023-10-14T11:25:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.087+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07601f7730 con 0x7f07601610f0 2023-10-14T11:25:11.104 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.088+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076004ebb0 con 0x7f07601610f0 2023-10-14T11:25:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.088+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0748003be0 con 0x7f07601610f0 2023-10-14T11:25:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.089+0000 7f0757fff700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 0x7f074006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:11.105 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.089+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f0748088a70 con 0x7f07601610f0 2023-10-14T11:25:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.089+0000 7f075e7fc700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 0x7f074006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.089+0000 7f075e7fc700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 0x7f074006d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07601607f0 tx=0x7f0750009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:11.106 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.093+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0748053b00 con 0x7f07601610f0 2023-10-14T11:25:11.291 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.290+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07601614d0 con 0x7f074006af00 2023-10-14T11:25:11.301 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.298+0000 7f0757fff700 1 -- 172.21.15.67:0/338866438 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290787 (secure 0 0 0) 0x7f0750001400 con 0x7f074006af00 2023-10-14T11:25:11.306 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:25:11.310 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.301+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 msgr2=0x7f074006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.301+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 0x7f074006d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07601607f0 tx=0x7f0750009040 comp rx=0 tx=0).stop 2023-10-14T11:25:11.311 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.301+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 msgr2=0x7f07601599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:11.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.301+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f074800c500 tx=0x7f074800c8c0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.312 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.301+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 shutdown_connections 2023-10-14T11:25:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0760162340 0x7f0760157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f074006af00 0x7f074006d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.313 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f07601610f0 0x7f07601599d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 --2- 172.21.15.67:0/338866438 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f0760161ee0 0x7f07600ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:11.314 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 >> 172.21.15.67:0/338866438 conn(0x7f076009cab0 msgr2=0x7f076015df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 shutdown_connections 2023-10-14T11:25:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:11.302+0000 7f0765a23700 1 -- 172.21.15.67:0/338866438 wait complete. 2023-10-14T11:25:11.315 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:25:11.317 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-14T11:25:10.435055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003339"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.618119+0000","last_change":"2023-10-14T11:24:22.618189+0000","last_active":"2023-10-14T11:24:22.618119+0000","last_peered":"2023-10-14T11:24:22.618119+0000","last_clean":"2023-10-14T11:24:22.618119+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:24:22.618119+0000","last_undegraded":"2023-10-14T11:24:22.618119+0000","last_fullsized":"2023-10-14T11:24:22.618119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.618001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:30.049607+0000","scrub_duration":0.00161269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:04.269978+0000","last_change":"2023-10-14T11:25:04.270025+0000","last_active":"2023-10-14T11:25:04.269978+0000","last_peered":"2023-10-14T11:25:04.269978+0000","last_clean":"2023-10-14T11:25:04.269978+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:25:04.269978+0000","last_undegraded":"2023-10-14T11:25:04.269978+0000","last_fullsized":"2023-10-14T11:25:04.269978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:04.269866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:04.269866+0000","last_clean_scrub_stamp":"2023-10-14T11:25:04.269866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:50.707879+0000","scrub_duration":0.0016454740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605488+0000","last_change":"2023-10-14T11:23:54.870190+0000","last_active":"2023-10-14T11:23:57.605488+0000","last_peered":"2023-10-14T11:23:57.605488+0000","last_clean":"2023-10-14T11:23:57.605488+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:23:57.605488+0000","last_undegraded":"2023-10-14T11:23:57.605488+0000","last_fullsized":"2023-10-14T11:23:57.605488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:23.043768+0000","last_change":"2023-10-14T11:24:23.043816+0000","last_active":"2023-10-14T11:24:23.043768+0000","last_peered":"2023-10-14T11:24:23.043768+0000","last_clean":"2023-10-14T11:24:23.043768+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:24:23.043768+0000","last_undegraded":"2023-10-14T11:24:23.043768+0000","last_fullsized":"2023-10-14T11:24:23.043768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_clean_scrub_stamp":"2023-10-14T11:24:23.043656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:35.724772+0000","scrub_duration":0.0018187660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.840180+0000","last_change":"2023-10-14T11:24:30.840272+0000","last_active":"2023-10-14T11:24:30.840180+0000","last_peered":"2023-10-14T11:24:30.840180+0000","last_clean":"2023-10-14T11:24:30.840180+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:24:30.840180+0000","last_undegraded":"2023-10-14T11:24:30.840180+0000","last_fullsized":"2023-10-14T11:24:30.840180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.840084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:55.609420+0000","scrub_duration":0.0012728209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:49.176613+0000","last_change":"2023-10-14T11:24:49.176665+0000","last_active":"2023-10-14T11:24:49.176613+0000","last_peered":"2023-10-14T11:24:49.176613+0000","last_clean":"2023-10-14T11:24:49.176613+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:24:49.176613+0000","last_undegraded":"2023-10-14T11:24:49.176613+0000","last_fullsized":"2023-10-14T11:24:49.176613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:49.176498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:49.176498+0000","last_clean_scrub_stamp":"2023-10-14T11:24:49.176498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:05:28.772654+0000","scrub_duration":0.001991994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.318224+0000","last_change":"2023-10-14T11:24:22.318269+0000","last_active":"2023-10-14T11:24:22.318224+0000","last_peered":"2023-10-14T11:24:22.318224+0000","last_clean":"2023-10-14T11:24:22.318224+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:24:22.318224+0000","last_undegraded":"2023-10-14T11:24:22.318224+0000","last_fullsized":"2023-10-14T11:24:22.318224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.318112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:23.265011+0000","scrub_duration":0.0015173540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:37.217234+0000","last_change":"2023-10-14T11:24:37.217302+0000","last_active":"2023-10-14T11:24:37.217234+0000","last_peered":"2023-10-14T11:24:37.217234+0000","last_clean":"2023-10-14T11:24:37.217234+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:24:37.217234+0000","last_undegraded":"2023-10-14T11:24:37.217234+0000","last_fullsized":"2023-10-14T11:24:37.217234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_clean_scrub_stamp":"2023-10-14T11:24:37.217072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:25.692049+0000","scrub_duration":0.001949898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:38.111581+0000","last_change":"2023-10-14T11:24:38.111626+0000","last_active":"2023-10-14T11:24:38.111581+0000","last_peered":"2023-10-14T11:24:38.111581+0000","last_clean":"2023-10-14T11:24:38.111581+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:24:38.111581+0000","last_undegraded":"2023-10-14T11:24:38.111581+0000","last_fullsized":"2023-10-14T11:24:38.111581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_clean_scrub_stamp":"2023-10-14T11:24:38.111461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:13.964177+0000","scrub_duration":0.0022767479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.962977+0000","last_change":"2023-10-14T11:24:35.963056+0000","last_active":"2023-10-14T11:24:35.962977+0000","last_peered":"2023-10-14T11:24:35.962977+0000","last_clean":"2023-10-14T11:24:35.962977+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:24:35.962977+0000","last_undegraded":"2023-10-14T11:24:35.962977+0000","last_fullsized":"2023-10-14T11:24:35.962977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.962819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:08.610979+0000","scrub_duration":0.0016532439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:46.282432+0000","last_change":"2023-10-14T11:24:46.282500+0000","last_active":"2023-10-14T11:24:46.282432+0000","last_peered":"2023-10-14T11:24:46.282432+0000","last_clean":"2023-10-14T11:24:46.282432+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:24:46.282432+0000","last_undegraded":"2023-10-14T11:24:46.282432+0000","last_fullsized":"2023-10-14T11:24:46.282432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_clean_scrub_stamp":"2023-10-14T11:24:46.282310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.824008+0000","scrub_duration":0.0019801269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:52.531777+0000","last_change":"2023-10-14T11:24:52.531820+0000","last_active":"2023-10-14T11:24:52.531777+0000","last_peered":"2023-10-14T11:24:52.531777+0000","last_clean":"2023-10-14T11:24:52.531777+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:24:52.531777+0000","last_undegraded":"2023-10-14T11:24:52.531777+0000","last_fullsized":"2023-10-14T11:24:52.531777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:52.531669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:52.531669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:52.531669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:42:13.216196+0000","scrub_duration":0.002117196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.652454+0000","last_change":"2023-10-14T11:24:12.652527+0000","last_active":"2023-10-14T11:24:12.652454+0000","last_peered":"2023-10-14T11:24:12.652454+0000","last_clean":"2023-10-14T11:24:12.652454+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:24:12.652454+0000","last_undegraded":"2023-10-14T11:24:12.652454+0000","last_fullsized":"2023-10-14T11:24:12.652454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.652307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:57.451092+0000","scrub_duration":0.0018306030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.160848+0000","last_change":"2023-10-14T11:24:34.160901+0000","last_active":"2023-10-14T11:24:34.160848+0000","last_peered":"2023-10-14T11:24:34.160848+0000","last_clean":"2023-10-14T11:24:34.160848+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:24:34.160848+0000","last_undegraded":"2023-10-14T11:24:34.160848+0000","last_fullsized":"2023-10-14T11:24:34.160848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.160718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.013434+0000","scrub_duration":0.001735412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:05.616491+0000","last_change":"2023-10-14T11:25:05.616564+0000","last_active":"2023-10-14T11:25:05.616491+0000","last_peered":"2023-10-14T11:25:05.616491+0000","last_clean":"2023-10-14T11:25:05.616491+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:25:05.616491+0000","last_undegraded":"2023-10-14T11:25:05.616491+0000","last_fullsized":"2023-10-14T11:25:05.616491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:05.616363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:05.616363+0000","last_clean_scrub_stamp":"2023-10-14T11:25:05.616363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:43.683219+0000","scrub_duration":0.001633247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.280516+0000","last_change":"2023-10-14T11:24:41.280574+0000","last_active":"2023-10-14T11:24:41.280516+0000","last_peered":"2023-10-14T11:24:41.280516+0000","last_clean":"2023-10-14T11:24:41.280516+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:24:41.280516+0000","last_undegraded":"2023-10-14T11:24:41.280516+0000","last_fullsized":"2023-10-14T11:24:41.280516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.280409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:19.511351+0000","scrub_duration":0.0022952070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:57.189565+0000","last_change":"2023-10-14T11:24:57.189665+0000","last_active":"2023-10-14T11:24:57.189565+0000","last_peered":"2023-10-14T11:24:57.189565+0000","last_clean":"2023-10-14T11:24:57.189565+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:24:57.189565+0000","last_undegraded":"2023-10-14T11:24:57.189565+0000","last_fullsized":"2023-10-14T11:24:57.189565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:57.189423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:57.189423+0000","last_clean_scrub_stamp":"2023-10-14T11:24:57.189423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:56:01.478698+0000","scrub_duration":0.0016789870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:56.467461+0000","last_change":"2023-10-14T11:23:54.857288+0000","last_active":"2023-10-14T11:23:56.467461+0000","last_peered":"2023-10-14T11:23:56.467461+0000","last_clean":"2023-10-14T11:23:56.467461+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:23:56.467461+0000","last_undegraded":"2023-10-14T11:23:56.467461+0000","last_fullsized":"2023-10-14T11:23:56.467461+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:03.279118+0000","last_change":"2023-10-14T11:25:03.279167+0000","last_active":"2023-10-14T11:25:03.279118+0000","last_peered":"2023-10-14T11:25:03.279118+0000","last_clean":"2023-10-14T11:25:03.279118+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:25:03.279118+0000","last_undegraded":"2023-10-14T11:25:03.279118+0000","last_fullsized":"2023-10-14T11:25:03.279118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:03.278991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:03.278991+0000","last_clean_scrub_stamp":"2023-10-14T11:25:03.278991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:21.571443+0000","scrub_duration":0.001784311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.818675+0000","last_change":"2023-10-14T11:24:31.818741+0000","last_active":"2023-10-14T11:24:31.818675+0000","last_peered":"2023-10-14T11:24:31.818675+0000","last_clean":"2023-10-14T11:24:31.818675+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:24:31.818675+0000","last_undegraded":"2023-10-14T11:24:31.818675+0000","last_fullsized":"2023-10-14T11:24:31.818675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.818485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:03.752400+0000","scrub_duration":0.0019508419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:29.933981+0000","last_change":"2023-10-14T11:24:29.934042+0000","last_active":"2023-10-14T11:24:29.933981+0000","last_peered":"2023-10-14T11:24:29.933981+0000","last_clean":"2023-10-14T11:24:29.933981+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:24:29.933981+0000","last_undegraded":"2023-10-14T11:24:29.933981+0000","last_fullsized":"2023-10-14T11:24:29.933981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_clean_scrub_stamp":"2023-10-14T11:24:29.933851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:12.764047+0000","scrub_duration":0.0021874860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:53.389266+0000","last_change":"2023-10-14T11:24:53.389331+0000","last_active":"2023-10-14T11:24:53.389266+0000","last_peered":"2023-10-14T11:24:53.389266+0000","last_clean":"2023-10-14T11:24:53.389266+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:24:53.389266+0000","last_undegraded":"2023-10-14T11:24:53.389266+0000","last_fullsized":"2023-10-14T11:24:53.389266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:53.389151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:53.389151+0000","last_clean_scrub_stamp":"2023-10-14T11:24:53.389151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:50.092980+0000","scrub_duration":0.002148708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.380454+0000","last_change":"2023-10-14T11:24:17.380528+0000","last_active":"2023-10-14T11:24:17.380454+0000","last_peered":"2023-10-14T11:24:17.380454+0000","last_clean":"2023-10-14T11:24:17.380454+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:24:17.380454+0000","last_undegraded":"2023-10-14T11:24:17.380454+0000","last_fullsized":"2023-10-14T11:24:17.380454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.380311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:49.314225+0000","scrub_duration":0.0020088469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.649868+0000","last_change":"2023-10-14T11:24:25.649924+0000","last_active":"2023-10-14T11:24:25.649868+0000","last_peered":"2023-10-14T11:24:25.649868+0000","last_clean":"2023-10-14T11:24:25.649868+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:24:25.649868+0000","last_undegraded":"2023-10-14T11:24:25.649868+0000","last_fullsized":"2023-10-14T11:24:25.649868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.649757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:50.342876+0000","scrub_duration":0.001768936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.032513+0000","last_change":"2023-10-14T11:24:24.032590+0000","last_active":"2023-10-14T11:24:24.032513+0000","last_peered":"2023-10-14T11:24:24.032513+0000","last_clean":"2023-10-14T11:24:24.032513+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:24:24.032513+0000","last_undegraded":"2023-10-14T11:24:24.032513+0000","last_fullsized":"2023-10-14T11:24:24.032513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.032364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:49.045417+0000","scrub_duration":0.0021628229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:50.213808+0000","last_change":"2023-10-14T11:24:50.213887+0000","last_active":"2023-10-14T11:24:50.213808+0000","last_peered":"2023-10-14T11:24:50.213808+0000","last_clean":"2023-10-14T11:24:50.213808+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:24:50.213808+0000","last_undegraded":"2023-10-14T11:24:50.213808+0000","last_fullsized":"2023-10-14T11:24:50.213808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:50.213649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:50.213649+0000","last_clean_scrub_stamp":"2023-10-14T11:24:50.213649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:56.907951+0000","scrub_duration":0.0020373320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.050980+0000","last_change":"2023-10-14T11:24:34.051034+0000","last_active":"2023-10-14T11:24:34.050980+0000","last_peered":"2023-10-14T11:24:34.050980+0000","last_clean":"2023-10-14T11:24:34.050980+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:24:34.050980+0000","last_undegraded":"2023-10-14T11:24:34.050980+0000","last_fullsized":"2023-10-14T11:24:34.050980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.050856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:23.081327+0000","scrub_duration":0.0022522530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.610958+0000","last_change":"2023-10-14T11:24:41.611049+0000","last_active":"2023-10-14T11:24:41.610958+0000","last_peered":"2023-10-14T11:24:41.610958+0000","last_clean":"2023-10-14T11:24:41.610958+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:24:41.610958+0000","last_undegraded":"2023-10-14T11:24:41.610958+0000","last_fullsized":"2023-10-14T11:24:41.610958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.610843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:53.135545+0000","scrub_duration":0.0021190929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:28.969856+0000","last_change":"2023-10-14T11:24:28.969918+0000","last_active":"2023-10-14T11:24:28.969856+0000","last_peered":"2023-10-14T11:24:28.969856+0000","last_clean":"2023-10-14T11:24:28.969856+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:24:28.969856+0000","last_undegraded":"2023-10-14T11:24:28.969856+0000","last_fullsized":"2023-10-14T11:24:28.969856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_clean_scrub_stamp":"2023-10-14T11:24:28.969745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:57.115286+0000","scrub_duration":0.0020373919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.293416+0000","last_change":"2023-10-14T11:24:35.293463+0000","last_active":"2023-10-14T11:24:35.293416+0000","last_peered":"2023-10-14T11:24:35.293416+0000","last_clean":"2023-10-14T11:24:35.293416+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:24:35.293416+0000","last_undegraded":"2023-10-14T11:24:35.293416+0000","last_fullsized":"2023-10-14T11:24:35.293416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.293296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:24.323767+0000","scrub_duration":0.0014562679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.612889+0000","last_change":"2023-10-14T11:24:19.612977+0000","last_active":"2023-10-14T11:24:19.612889+0000","last_peered":"2023-10-14T11:24:19.612889+0000","last_clean":"2023-10-14T11:24:19.612889+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:24:19.612889+0000","last_undegraded":"2023-10-14T11:24:19.612889+0000","last_fullsized":"2023-10-14T11:24:19.612889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.612775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:28.923551+0000","scrub_duration":0.0020682040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.353591+0000","last_change":"2023-10-14T11:24:18.353635+0000","last_active":"2023-10-14T11:24:18.353591+0000","last_peered":"2023-10-14T11:24:18.353591+0000","last_clean":"2023-10-14T11:24:18.353591+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:24:18.353591+0000","last_undegraded":"2023-10-14T11:24:18.353591+0000","last_fullsized":"2023-10-14T11:24:18.353591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.353458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:12.119177+0000","scrub_duration":0.001475496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.371536+0000","last_change":"2023-10-14T11:24:26.371583+0000","last_active":"2023-10-14T11:24:26.371536+0000","last_peered":"2023-10-14T11:24:26.371536+0000","last_clean":"2023-10-14T11:24:26.371536+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:24:26.371536+0000","last_undegraded":"2023-10-14T11:24:26.371536+0000","last_fullsized":"2023-10-14T11:24:26.371536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.371421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:10.031597+0000","scrub_duration":0.002261239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.572146+0000","last_change":"2023-10-14T11:24:12.572201+0000","last_active":"2023-10-14T11:24:12.572146+0000","last_peered":"2023-10-14T11:24:12.572146+0000","last_clean":"2023-10-14T11:24:12.572146+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:24:12.572146+0000","last_undegraded":"2023-10-14T11:24:12.572146+0000","last_fullsized":"2023-10-14T11:24:12.572146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.572029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:05.536861+0000","scrub_duration":0.0021884140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.588810+0000","last_change":"2023-10-14T11:24:20.588873+0000","last_active":"2023-10-14T11:24:20.588810+0000","last_peered":"2023-10-14T11:24:20.588810+0000","last_clean":"2023-10-14T11:24:20.588810+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:24:20.588810+0000","last_undegraded":"2023-10-14T11:24:20.588810+0000","last_fullsized":"2023-10-14T11:24:20.588810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.588675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:49.622214+0000","scrub_duration":0.0016745919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.359903+0000","last_change":"2023-10-14T11:24:16.359975+0000","last_active":"2023-10-14T11:24:16.359903+0000","last_peered":"2023-10-14T11:24:16.359903+0000","last_clean":"2023-10-14T11:24:16.359903+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:24:16.359903+0000","last_undegraded":"2023-10-14T11:24:16.359903+0000","last_fullsized":"2023-10-14T11:24:16.359903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.359793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.129129+0000","scrub_duration":0.002300818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:55.365667+0000","last_change":"2023-10-14T11:24:55.365748+0000","last_active":"2023-10-14T11:24:55.365667+0000","last_peered":"2023-10-14T11:24:55.365667+0000","last_clean":"2023-10-14T11:24:55.365667+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:24:55.365667+0000","last_undegraded":"2023-10-14T11:24:55.365667+0000","last_fullsized":"2023-10-14T11:24:55.365667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:55.365553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:55.365553+0000","last_clean_scrub_stamp":"2023-10-14T11:24:55.365553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:45.835100+0000","scrub_duration":0.0022324699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.224194+0000","last_change":"2023-10-14T11:24:25.224252+0000","last_active":"2023-10-14T11:24:25.224194+0000","last_peered":"2023-10-14T11:24:25.224194+0000","last_clean":"2023-10-14T11:24:25.224194+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:24:25.224194+0000","last_undegraded":"2023-10-14T11:24:25.224194+0000","last_fullsized":"2023-10-14T11:24:25.224194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.224080+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:08.054276+0000","scrub_duration":0.0030700860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.938216+0000","last_change":"2023-10-14T11:24:30.938255+0000","last_active":"2023-10-14T11:24:30.938216+0000","last_peered":"2023-10-14T11:24:30.938216+0000","last_clean":"2023-10-14T11:24:30.938216+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:24:30.938216+0000","last_undegraded":"2023-10-14T11:24:30.938216+0000","last_fullsized":"2023-10-14T11:24:30.938216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.938126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.687486+0000","scrub_duration":0.0018420349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.657769+0000","last_change":"2023-10-14T11:24:10.657818+0000","last_active":"2023-10-14T11:24:10.657769+0000","last_peered":"2023-10-14T11:24:10.657769+0000","last_clean":"2023-10-14T11:24:10.657769+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:24:10.657769+0000","last_undegraded":"2023-10-14T11:24:10.657769+0000","last_fullsized":"2023-10-14T11:24:10.657769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.657669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:51.690631+0000","scrub_duration":0.0017120919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:49.204817+0000","last_change":"2023-10-14T11:24:49.204864+0000","last_active":"2023-10-14T11:24:49.204817+0000","last_peered":"2023-10-14T11:24:49.204817+0000","last_clean":"2023-10-14T11:24:49.204817+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:24:49.204817+0000","last_undegraded":"2023-10-14T11:24:49.204817+0000","last_fullsized":"2023-10-14T11:24:49.204817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:49.204714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:49.204714+0000","last_clean_scrub_stamp":"2023-10-14T11:24:49.204714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:25.057430+0000","scrub_duration":0.001618186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.955178+0000","last_change":"2023-10-14T11:24:22.955233+0000","last_active":"2023-10-14T11:24:22.955178+0000","last_peered":"2023-10-14T11:24:22.955178+0000","last_clean":"2023-10-14T11:24:22.955178+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:24:22.955178+0000","last_undegraded":"2023-10-14T11:24:22.955178+0000","last_fullsized":"2023-10-14T11:24:22.955178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.955060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:16.720779+0000","scrub_duration":0.0019597210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:50.513923+0000","last_change":"2023-10-14T11:24:50.514004+0000","last_active":"2023-10-14T11:24:50.513923+0000","last_peered":"2023-10-14T11:24:50.513923+0000","last_clean":"2023-10-14T11:24:50.513923+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:24:50.513923+0000","last_undegraded":"2023-10-14T11:24:50.513923+0000","last_fullsized":"2023-10-14T11:24:50.513923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:50.513795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:50.513795+0000","last_clean_scrub_stamp":"2023-10-14T11:24:50.513795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:28.744737+0000","scrub_duration":0.002022341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.031156+0000","last_change":"2023-10-14T11:24:19.031223+0000","last_active":"2023-10-14T11:24:19.031156+0000","last_peered":"2023-10-14T11:24:19.031156+0000","last_clean":"2023-10-14T11:24:19.031156+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:24:19.031156+0000","last_undegraded":"2023-10-14T11:24:19.031156+0000","last_fullsized":"2023-10-14T11:24:19.031156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.031043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:14.404949+0000","scrub_duration":0.002047484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.938331+0000","last_change":"2023-10-14T11:24:31.938378+0000","last_active":"2023-10-14T11:24:31.938331+0000","last_peered":"2023-10-14T11:24:31.938331+0000","last_clean":"2023-10-14T11:24:31.938331+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:24:31.938331+0000","last_undegraded":"2023-10-14T11:24:31.938331+0000","last_fullsized":"2023-10-14T11:24:31.938331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.938227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:52.622754+0000","scrub_duration":0.00144428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.033528+0000","last_change":"2023-10-14T11:24:16.033579+0000","last_active":"2023-10-14T11:24:16.033528+0000","last_peered":"2023-10-14T11:24:16.033528+0000","last_clean":"2023-10-14T11:24:16.033528+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:24:16.033528+0000","last_undegraded":"2023-10-14T11:24:16.033528+0000","last_fullsized":"2023-10-14T11:24:16.033528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.033420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:16.980319+0000","scrub_duration":0.0015776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.007336+0000","last_change":"2023-10-14T11:24:35.007399+0000","last_active":"2023-10-14T11:24:35.007336+0000","last_peered":"2023-10-14T11:24:35.007336+0000","last_clean":"2023-10-14T11:24:35.007336+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:24:35.007336+0000","last_undegraded":"2023-10-14T11:24:35.007336+0000","last_fullsized":"2023-10-14T11:24:35.007336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.007224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:23.482201+0000","scrub_duration":0.0022040940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.918317+0000","last_change":"2023-10-14T11:24:12.918415+0000","last_active":"2023-10-14T11:24:12.918317+0000","last_peered":"2023-10-14T11:24:12.918317+0000","last_clean":"2023-10-14T11:24:12.918317+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:24:12.918317+0000","last_undegraded":"2023-10-14T11:24:12.918317+0000","last_fullsized":"2023-10-14T11:24:12.918317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.918195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:41.951734+0000","scrub_duration":0.001509102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:00.483927+0000","last_change":"2023-10-14T11:25:00.483978+0000","last_active":"2023-10-14T11:25:00.483927+0000","last_peered":"2023-10-14T11:25:00.483927+0000","last_clean":"2023-10-14T11:25:00.483927+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:25:00.483927+0000","last_undegraded":"2023-10-14T11:25:00.483927+0000","last_fullsized":"2023-10-14T11:25:00.483927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:00.483812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:00.483812+0000","last_clean_scrub_stamp":"2023-10-14T11:25:00.483812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:36.336529+0000","scrub_duration":0.002013468,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.117423+0000","last_change":"2023-10-14T11:24:20.117501+0000","last_active":"2023-10-14T11:24:20.117423+0000","last_peered":"2023-10-14T11:24:20.117423+0000","last_clean":"2023-10-14T11:24:20.117423+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:24:20.117423+0000","last_undegraded":"2023-10-14T11:24:20.117423+0000","last_fullsized":"2023-10-14T11:24:20.117423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.117283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:09.147754+0000","scrub_duration":0.002212463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:58.253646+0000","last_change":"2023-10-14T11:24:58.253697+0000","last_active":"2023-10-14T11:24:58.253646+0000","last_peered":"2023-10-14T11:24:58.253646+0000","last_clean":"2023-10-14T11:24:58.253646+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:24:58.253646+0000","last_undegraded":"2023-10-14T11:24:58.253646+0000","last_fullsized":"2023-10-14T11:24:58.253646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:58.253521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:58.253521+0000","last_clean_scrub_stamp":"2023-10-14T11:24:58.253521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:27.287553+0000","scrub_duration":0.0015270069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.367700+0000","last_change":"2023-10-14T11:24:15.367749+0000","last_active":"2023-10-14T11:24:15.367700+0000","last_peered":"2023-10-14T11:24:15.367700+0000","last_clean":"2023-10-14T11:24:15.367700+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:24:15.367700+0000","last_undegraded":"2023-10-14T11:24:15.367700+0000","last_fullsized":"2023-10-14T11:24:15.367700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.367586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:36.189165+0000","scrub_duration":0.001682048,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.001748+0000","last_change":"2023-10-14T11:24:10.001813+0000","last_active":"2023-10-14T11:24:10.001748+0000","last_peered":"2023-10-14T11:24:10.001748+0000","last_clean":"2023-10-14T11:24:10.001748+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:24:10.001748+0000","last_undegraded":"2023-10-14T11:24:10.001748+0000","last_fullsized":"2023-10-14T11:24:10.001748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.001627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:51.478987+0000","scrub_duration":0.001776112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.629817+0000","last_change":"2023-10-14T11:24:22.629870+0000","last_active":"2023-10-14T11:24:22.629817+0000","last_peered":"2023-10-14T11:24:22.629817+0000","last_clean":"2023-10-14T11:24:22.629817+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:24:22.629817+0000","last_undegraded":"2023-10-14T11:24:22.629817+0000","last_fullsized":"2023-10-14T11:24:22.629817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.629697+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:04.107057+0000","scrub_duration":0.0021629869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605584+0000","last_change":"2023-10-14T11:23:54.870092+0000","last_active":"2023-10-14T11:23:57.605584+0000","last_peered":"2023-10-14T11:23:57.605584+0000","last_clean":"2023-10-14T11:23:57.605584+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:23:57.605584+0000","last_undegraded":"2023-10-14T11:23:57.605584+0000","last_fullsized":"2023-10-14T11:23:57.605584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:14.989113+0000","last_change":"2023-10-14T11:24:14.989170+0000","last_active":"2023-10-14T11:24:14.989113+0000","last_peered":"2023-10-14T11:24:14.989113+0000","last_clean":"2023-10-14T11:24:14.989113+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:24:14.989113+0000","last_undegraded":"2023-10-14T11:24:14.989113+0000","last_fullsized":"2023-10-14T11:24:14.989113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_clean_scrub_stamp":"2023-10-14T11:24:14.988999+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:08.754718+0000","scrub_duration":0.0030364979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.174066+0000","last_change":"2023-10-14T11:24:18.174117+0000","last_active":"2023-10-14T11:24:18.174066+0000","last_peered":"2023-10-14T11:24:18.174066+0000","last_clean":"2023-10-14T11:24:18.174066+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:24:18.174066+0000","last_undegraded":"2023-10-14T11:24:18.174066+0000","last_fullsized":"2023-10-14T11:24:18.174066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.173944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:01.834121+0000","scrub_duration":0.0025641790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.947992+0000","last_change":"2023-10-14T11:24:13.948045+0000","last_active":"2023-10-14T11:24:13.947992+0000","last_peered":"2023-10-14T11:24:13.947992+0000","last_clean":"2023-10-14T11:24:13.947992+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:24:13.947992+0000","last_undegraded":"2023-10-14T11:24:13.947992+0000","last_fullsized":"2023-10-14T11:24:13.947992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.947888+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:11.579179+0000","scrub_duration":0.002298937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:45.115302+0000","last_change":"2023-10-14T11:24:45.115354+0000","last_active":"2023-10-14T11:24:45.115302+0000","last_peered":"2023-10-14T11:24:45.115302+0000","last_clean":"2023-10-14T11:24:45.115302+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:24:45.115302+0000","last_undegraded":"2023-10-14T11:24:45.115302+0000","last_fullsized":"2023-10-14T11:24:45.115302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_clean_scrub_stamp":"2023-10-14T11:24:45.115192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:41.051192+0000","scrub_duration":0.001751362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.193107+0000","last_change":"2023-10-14T11:24:15.193158+0000","last_active":"2023-10-14T11:24:15.193107+0000","last_peered":"2023-10-14T11:24:15.193107+0000","last_clean":"2023-10-14T11:24:15.193107+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:24:15.193107+0000","last_undegraded":"2023-10-14T11:24:15.193107+0000","last_fullsized":"2023-10-14T11:24:15.193107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.193011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:15.570002+0000","scrub_duration":0.0020719250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:54.188065+0000","last_change":"2023-10-14T11:24:54.188157+0000","last_active":"2023-10-14T11:24:54.188065+0000","last_peered":"2023-10-14T11:24:54.188065+0000","last_clean":"2023-10-14T11:24:54.188065+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:24:54.188065+0000","last_undegraded":"2023-10-14T11:24:54.188065+0000","last_fullsized":"2023-10-14T11:24:54.188065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:54.187946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:54.187946+0000","last_clean_scrub_stamp":"2023-10-14T11:24:54.187946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:55.517868+0000","scrub_duration":0.001521131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.075214+0000","last_change":"2023-10-14T11:24:18.075260+0000","last_active":"2023-10-14T11:24:18.075214+0000","last_peered":"2023-10-14T11:24:18.075214+0000","last_clean":"2023-10-14T11:24:18.075214+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:24:18.075214+0000","last_undegraded":"2023-10-14T11:24:18.075214+0000","last_fullsized":"2023-10-14T11:24:18.075214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.075105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:57:07.333526+0000","scrub_duration":0.0020020939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.600778+0000","last_change":"2023-10-14T11:24:18.600826+0000","last_active":"2023-10-14T11:24:18.600778+0000","last_peered":"2023-10-14T11:24:18.600778+0000","last_clean":"2023-10-14T11:24:18.600778+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:24:18.600778+0000","last_undegraded":"2023-10-14T11:24:18.600778+0000","last_fullsized":"2023-10-14T11:24:18.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.600643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:39.422221+0000","scrub_duration":0.001627075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.039119+0000","last_change":"2023-10-14T11:24:17.039213+0000","last_active":"2023-10-14T11:24:17.039119+0000","last_peered":"2023-10-14T11:24:17.039119+0000","last_clean":"2023-10-14T11:24:17.039119+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:24:17.039119+0000","last_undegraded":"2023-10-14T11:24:17.039119+0000","last_fullsized":"2023-10-14T11:24:17.039119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.038941+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:35.598811+0000","scrub_duration":0.0024319699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:27.919753+0000","last_change":"2023-10-14T11:24:27.919799+0000","last_active":"2023-10-14T11:24:27.919753+0000","last_peered":"2023-10-14T11:24:27.919753+0000","last_clean":"2023-10-14T11:24:27.919753+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:24:27.919753+0000","last_undegraded":"2023-10-14T11:24:27.919753+0000","last_fullsized":"2023-10-14T11:24:27.919753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_clean_scrub_stamp":"2023-10-14T11:24:27.919641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:39.444343+0000","scrub_duration":0.001583232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:07.216148+0000","last_change":"2023-10-14T11:24:07.216215+0000","last_active":"2023-10-14T11:24:07.216148+0000","last_peered":"2023-10-14T11:24:07.216148+0000","last_clean":"2023-10-14T11:24:07.216148+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:24:07.216148+0000","last_undegraded":"2023-10-14T11:24:07.216148+0000","last_fullsized":"2023-10-14T11:24:07.216148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_clean_scrub_stamp":"2023-10-14T11:24:07.216014+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:28.037593+0000","scrub_duration":0.001805564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:48.517995+0000","last_change":"2023-10-14T11:24:48.518043+0000","last_active":"2023-10-14T11:24:48.517995+0000","last_peered":"2023-10-14T11:24:48.517995+0000","last_clean":"2023-10-14T11:24:48.517995+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:24:48.517995+0000","last_undegraded":"2023-10-14T11:24:48.517995+0000","last_fullsized":"2023-10-14T11:24:48.517995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:48.517888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:48.517888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:48.517888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:31.348083+0000","scrub_duration":0.001589675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.928168+0000","last_change":"2023-10-14T11:24:26.928221+0000","last_active":"2023-10-14T11:24:26.928168+0000","last_peered":"2023-10-14T11:24:26.928168+0000","last_clean":"2023-10-14T11:24:26.928168+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:24:26.928168+0000","last_undegraded":"2023-10-14T11:24:26.928168+0000","last_fullsized":"2023-10-14T11:24:26.928168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.928047+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:45.487917+0000","scrub_duration":0.002943017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:36.993836+0000","last_change":"2023-10-14T11:24:36.993895+0000","last_active":"2023-10-14T11:24:36.993836+0000","last_peered":"2023-10-14T11:24:36.993836+0000","last_clean":"2023-10-14T11:24:36.993836+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:24:36.993836+0000","last_undegraded":"2023-10-14T11:24:36.993836+0000","last_fullsized":"2023-10-14T11:24:36.993836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_clean_scrub_stamp":"2023-10-14T11:24:36.993722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:40.645496+0000","scrub_duration":0.0019673289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.964012+0000","last_change":"2023-10-14T11:24:11.964066+0000","last_active":"2023-10-14T11:24:11.964012+0000","last_peered":"2023-10-14T11:24:11.964012+0000","last_clean":"2023-10-14T11:24:11.964012+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:24:11.964012+0000","last_undegraded":"2023-10-14T11:24:11.964012+0000","last_fullsized":"2023-10-14T11:24:11.964012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.963898+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:00.000285+0000","scrub_duration":0.0025292790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.776905+0000","last_change":"2023-10-14T11:24:32.776965+0000","last_active":"2023-10-14T11:24:32.776905+0000","last_peered":"2023-10-14T11:24:32.776905+0000","last_clean":"2023-10-14T11:24:32.776905+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:24:32.776905+0000","last_undegraded":"2023-10-14T11:24:32.776905+0000","last_fullsized":"2023-10-14T11:24:32.776905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.776767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:30.408058+0000","scrub_duration":0.0019839609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.997169+0000","last_change":"2023-10-14T11:24:24.997231+0000","last_active":"2023-10-14T11:24:24.997169+0000","last_peered":"2023-10-14T11:24:24.997169+0000","last_clean":"2023-10-14T11:24:24.997169+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:24:24.997169+0000","last_undegraded":"2023-10-14T11:24:24.997169+0000","last_fullsized":"2023-10-14T11:24:24.997169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.997051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:25.943950+0000","scrub_duration":0.0018370400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.658392+0000","last_change":"2023-10-14T11:24:16.658443+0000","last_active":"2023-10-14T11:24:16.658392+0000","last_peered":"2023-10-14T11:24:16.658392+0000","last_clean":"2023-10-14T11:24:16.658392+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:24:16.658392+0000","last_undegraded":"2023-10-14T11:24:16.658392+0000","last_fullsized":"2023-10-14T11:24:16.658392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.658265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:09.623097+0000","scrub_duration":0.002318826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:06.515192+0000","last_change":"2023-10-14T11:24:06.515272+0000","last_active":"2023-10-14T11:24:06.515192+0000","last_peered":"2023-10-14T11:24:06.515192+0000","last_clean":"2023-10-14T11:24:06.515192+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:24:06.515192+0000","last_undegraded":"2023-10-14T11:24:06.515192+0000","last_fullsized":"2023-10-14T11:24:06.515192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_clean_scrub_stamp":"2023-10-14T11:24:06.515039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:17.317480+0000","scrub_duration":0.001648042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.679270+0000","last_change":"2023-10-14T11:24:20.679372+0000","last_active":"2023-10-14T11:24:20.679270+0000","last_peered":"2023-10-14T11:24:20.679270+0000","last_clean":"2023-10-14T11:24:20.679270+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:24:20.679270+0000","last_undegraded":"2023-10-14T11:24:20.679270+0000","last_fullsized":"2023-10-14T11:24:20.679270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.679137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:25.181756+0000","scrub_duration":0.0016657740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.623905+0000","last_change":"2023-10-14T11:24:16.623954+0000","last_active":"2023-10-14T11:24:16.623905+0000","last_peered":"2023-10-14T11:24:16.623905+0000","last_clean":"2023-10-14T11:24:16.623905+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:24:16.623905+0000","last_undegraded":"2023-10-14T11:24:16.623905+0000","last_fullsized":"2023-10-14T11:24:16.623905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.623790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:10.423515+0000","scrub_duration":0.0020869059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.646219+0000","last_change":"2023-10-14T11:24:11.646268+0000","last_active":"2023-10-14T11:24:11.646219+0000","last_peered":"2023-10-14T11:24:11.646219+0000","last_clean":"2023-10-14T11:24:11.646219+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:24:11.646219+0000","last_undegraded":"2023-10-14T11:24:11.646219+0000","last_fullsized":"2023-10-14T11:24:11.646219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.646099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:23.978037+0000","scrub_duration":0.001698242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.988120+0000","last_change":"2023-10-14T11:24:17.988172+0000","last_active":"2023-10-14T11:24:17.988120+0000","last_peered":"2023-10-14T11:24:17.988120+0000","last_clean":"2023-10-14T11:24:17.988120+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:24:17.988120+0000","last_undegraded":"2023-10-14T11:24:17.988120+0000","last_fullsized":"2023-10-14T11:24:17.988120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.988015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:59.465375+0000","scrub_duration":0.0020367390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:56.222306+0000","last_change":"2023-10-14T11:24:56.222376+0000","last_active":"2023-10-14T11:24:56.222306+0000","last_peered":"2023-10-14T11:24:56.222306+0000","last_clean":"2023-10-14T11:24:56.222306+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:24:56.222306+0000","last_undegraded":"2023-10-14T11:24:56.222306+0000","last_fullsized":"2023-10-14T11:24:56.222306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:56.222178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:56.222178+0000","last_clean_scrub_stamp":"2023-10-14T11:24:56.222178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:52.926007+0000","scrub_duration":0.0017016449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.626811+0000","last_change":"2023-10-14T11:24:24.626862+0000","last_active":"2023-10-14T11:24:24.626811+0000","last_peered":"2023-10-14T11:24:24.626811+0000","last_clean":"2023-10-14T11:24:24.626811+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:24:24.626811+0000","last_undegraded":"2023-10-14T11:24:24.626811+0000","last_fullsized":"2023-10-14T11:24:24.626811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.626702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:08.286879+0000","scrub_duration":0.001499691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.826017+0000","last_change":"2023-10-14T11:24:34.826073+0000","last_active":"2023-10-14T11:24:34.826017+0000","last_peered":"2023-10-14T11:24:34.826017+0000","last_clean":"2023-10-14T11:24:34.826017+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:24:34.826017+0000","last_undegraded":"2023-10-14T11:24:34.826017+0000","last_fullsized":"2023-10-14T11:24:34.826017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.825890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:37.040029+0000","scrub_duration":0.001947362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.137672+0000","last_change":"2023-10-14T11:24:12.137759+0000","last_active":"2023-10-14T11:24:12.137672+0000","last_peered":"2023-10-14T11:24:12.137672+0000","last_clean":"2023-10-14T11:24:12.137672+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:24:12.137672+0000","last_undegraded":"2023-10-14T11:24:12.137672+0000","last_fullsized":"2023-10-14T11:24:12.137672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.137511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:19.569117+0000","scrub_duration":0.0022568279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:23:57.605641+0000","last_change":"2023-10-14T11:23:54.870175+0000","last_active":"2023-10-14T11:23:57.605641+0000","last_peered":"2023-10-14T11:23:57.605641+0000","last_clean":"2023-10-14T11:23:57.605641+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:23:57.605641+0000","last_undegraded":"2023-10-14T11:23:57.605641+0000","last_fullsized":"2023-10-14T11:23:57.605641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:23:53.822982+0000","last_clean_scrub_stamp":"2023-10-14T11:23:53.822982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.379212+0000","last_change":"2023-10-14T11:24:13.379271+0000","last_active":"2023-10-14T11:24:13.379212+0000","last_peered":"2023-10-14T11:24:13.379212+0000","last_clean":"2023-10-14T11:24:13.379212+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:24:13.379212+0000","last_undegraded":"2023-10-14T11:24:13.379212+0000","last_fullsized":"2023-10-14T11:24:13.379212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.379092+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:17.881711+0000","scrub_duration":0.00205668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.349746+0000","last_change":"2023-10-14T11:24:18.349802+0000","last_active":"2023-10-14T11:24:18.349746+0000","last_peered":"2023-10-14T11:24:18.349746+0000","last_clean":"2023-10-14T11:24:18.349746+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:24:18.349746+0000","last_undegraded":"2023-10-14T11:24:18.349746+0000","last_fullsized":"2023-10-14T11:24:18.349746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.349596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:15.980887+0000","scrub_duration":0.0016496950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.201195+0000","last_change":"2023-10-14T11:24:16.201259+0000","last_active":"2023-10-14T11:24:16.201195+0000","last_peered":"2023-10-14T11:24:16.201195+0000","last_clean":"2023-10-14T11:24:16.201195+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:24:16.201195+0000","last_undegraded":"2023-10-14T11:24:16.201195+0000","last_fullsized":"2023-10-14T11:24:16.201195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.201090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:24.787692+0000","scrub_duration":0.0016295120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.661091+0000","last_change":"2023-10-14T11:24:25.661135+0000","last_active":"2023-10-14T11:24:25.661091+0000","last_peered":"2023-10-14T11:24:25.661091+0000","last_clean":"2023-10-14T11:24:25.661091+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:24:25.661091+0000","last_undegraded":"2023-10-14T11:24:25.661091+0000","last_fullsized":"2023-10-14T11:24:25.661091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.660987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:27.875126+0000","scrub_duration":0.0019431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.446770+0000","last_change":"2023-10-14T11:24:10.446815+0000","last_active":"2023-10-14T11:24:10.446770+0000","last_peered":"2023-10-14T11:24:10.446770+0000","last_clean":"2023-10-14T11:24:10.446770+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:24:10.446770+0000","last_undegraded":"2023-10-14T11:24:10.446770+0000","last_fullsized":"2023-10-14T11:24:10.446770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.446679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:49.333800+0000","scrub_duration":0.0018293230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.387752+0000","last_change":"2023-10-14T11:24:20.387801+0000","last_active":"2023-10-14T11:24:20.387752+0000","last_peered":"2023-10-14T11:24:20.387752+0000","last_clean":"2023-10-14T11:24:20.387752+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:24:20.387752+0000","last_undegraded":"2023-10-14T11:24:20.387752+0000","last_fullsized":"2023-10-14T11:24:20.387752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.387627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:28.974229+0000","scrub_duration":0.001943073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:08.171269+0000","last_change":"2023-10-14T11:24:08.171308+0000","last_active":"2023-10-14T11:24:08.171269+0000","last_peered":"2023-10-14T11:24:08.171269+0000","last_clean":"2023-10-14T11:24:08.171269+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:24:08.171269+0000","last_undegraded":"2023-10-14T11:24:08.171269+0000","last_fullsized":"2023-10-14T11:24:08.171269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_clean_scrub_stamp":"2023-10-14T11:24:08.171180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:17.481955+0000","scrub_duration":0.0018328719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.123711+0000","last_change":"2023-10-14T11:24:32.123785+0000","last_active":"2023-10-14T11:24:32.123711+0000","last_peered":"2023-10-14T11:24:32.123711+0000","last_clean":"2023-10-14T11:24:32.123711+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:24:32.123711+0000","last_undegraded":"2023-10-14T11:24:32.123711+0000","last_fullsized":"2023-10-14T11:24:32.123711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.123562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:19.665259+0000","scrub_duration":0.0016330889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.978070+0000","last_change":"2023-10-14T11:24:15.978119+0000","last_active":"2023-10-14T11:24:15.978070+0000","last_peered":"2023-10-14T11:24:15.978070+0000","last_clean":"2023-10-14T11:24:15.978070+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:24:15.978070+0000","last_undegraded":"2023-10-14T11:24:15.978070+0000","last_fullsized":"2023-10-14T11:24:15.978070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.977938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:18.192077+0000","scrub_duration":0.0017069959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:39.082766+0000","last_change":"2023-10-14T11:24:39.082831+0000","last_active":"2023-10-14T11:24:39.082766+0000","last_peered":"2023-10-14T11:24:39.082766+0000","last_clean":"2023-10-14T11:24:39.082766+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:24:39.082766+0000","last_undegraded":"2023-10-14T11:24:39.082766+0000","last_fullsized":"2023-10-14T11:24:39.082766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_clean_scrub_stamp":"2023-10-14T11:24:39.082622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.935204+0000","scrub_duration":0.002294815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.980966+0000","last_change":"2023-10-14T11:24:10.981021+0000","last_active":"2023-10-14T11:24:10.980966+0000","last_peered":"2023-10-14T11:24:10.980966+0000","last_clean":"2023-10-14T11:24:10.980966+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:24:10.980966+0000","last_undegraded":"2023-10-14T11:24:10.980966+0000","last_fullsized":"2023-10-14T11:24:10.980966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.980842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:54.641019+0000","scrub_duration":0.0019702180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:53.228137+0000","last_change":"2023-10-14T11:24:53.228189+0000","last_active":"2023-10-14T11:24:53.228137+0000","last_peered":"2023-10-14T11:24:53.228137+0000","last_clean":"2023-10-14T11:24:53.228137+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:24:53.228137+0000","last_undegraded":"2023-10-14T11:24:53.228137+0000","last_fullsized":"2023-10-14T11:24:53.228137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:53.228008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:53.228008+0000","last_clean_scrub_stamp":"2023-10-14T11:24:53.228008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:13.080591+0000","scrub_duration":0.00196137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.561706+0000","last_change":"2023-10-14T11:24:10.561759+0000","last_active":"2023-10-14T11:24:10.561706+0000","last_peered":"2023-10-14T11:24:10.561706+0000","last_clean":"2023-10-14T11:24:10.561706+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:24:10.561706+0000","last_undegraded":"2023-10-14T11:24:10.561706+0000","last_fullsized":"2023-10-14T11:24:10.561706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.561597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:55.360382+0000","scrub_duration":0.0015897629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":186,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.419316+0000","last_change":"2023-10-14T11:24:11.419316+0000","last_active":"2023-10-14T11:24:11.419316+0000","last_peered":"2023-10-14T11:24:11.419316+0000","last_clean":"2023-10-14T11:24:11.419316+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:24:11.419316+0000","last_undegraded":"2023-10-14T11:24:11.419316+0000","last_fullsized":"2023-10-14T11:24:11.419316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.419125+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:27.365475+0000","scrub_duration":0.0059804070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.629}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66000000000000003,"5min":1.089,"15min":1.089},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.443,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61199999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.77700000000000002,"5min":1.641,"15min":1.641},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71299999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69099999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.75600000000000001,"5min":0.879,"15min":0.879},"last":0.53700000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.47199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.44500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.626},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.47599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70999999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55000000000000004}]},{"osd":3,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.63800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.37}]},{"osd":5,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40899999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.56899999999999995,"15min":0.60199999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.58899999999999997,"5min":4.923,"15min":4.923},"last":0.434},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.378},{"interface":"front","average":{"1min":0.443,"5min":0.65500000000000003,"15min":0.68999999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.60299999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.64300000000000002,"15min":0.67500000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.61799999999999999,"15min":0.64800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57599999999999996,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.44800000000000001}]},{"osd":4,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.83599999999999997,"15min":0.875},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81899999999999995,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":0.88400000000000001},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93200000000000005,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":5.665,"15min":5.665},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.68999999999999995}]},{"osd":6,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.86299999999999999,"15min":0.89900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89100000000000001,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.872,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88700000000000001,"5min":5.548,"15min":5.548},"last":0.66300000000000003}]},{"osd":7,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.89500000000000002,"15min":0.93400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86099999999999999,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.86599999999999999,"15min":0.89800000000000002},"min":{"1min":0.44500000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.70699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.62},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70099999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.32000000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.626,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.503},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65000000000000002,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.52300000000000002}]},{"osd":3,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55000000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.54700000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.81899999999999995,"15min":0.85099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93700000000000006,"5min":4.952,"15min":4.952},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.012,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.86899999999999999,"15min":0.90100000000000002},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.25,"15min":1.25},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.71499999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97599999999999998,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.93300000000000005,"5min":1.296,"15min":1.296},"last":0.77700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58599999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.30599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55400000000000005,"5min":0.874,"15min":0.874},"last":0.40699999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.222,"15min":0.222},"max":{"1min":0.63,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.45200000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42299999999999999,"15min":0.42099999999999999},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63200000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.433}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91800000000000004,"5min":1.944,"15min":1.944},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80600000000000005,"5min":1.72,"15min":1.72},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.80700000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.782,"15min":1.782},"last":0.625}]},{"osd":7,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86599999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":1.673,"15min":1.673},"last":0.67800000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.505,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.373},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.52400000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.318,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.32300000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63200000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.54400000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":1.002,"15min":1.002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55800000000000005}]},{"osd":5,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.49199999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.093,"15min":1.093},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68000000000000005}]},{"osd":6,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85599999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.55200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":1.431,"15min":1.431},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78800000000000003,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.63100000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83799999999999997,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82699999999999996,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":5.625,"15min":5.625},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.86399999999999999,"15min":0.90600000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.72399999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.46800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85699999999999998,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.70799999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63300000000000001,"5min":1.488,"15min":1.488},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":1.004,"15min":1.004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.495}]},{"osd":7,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73899999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.755},"last":0.63700000000000001}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.62},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55800000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.70499999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.374,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69699999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":1.089,"15min":1.089},"last":0.59299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:25:11.324 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:25:11.324 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:25:11.325 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:25:11.326 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-10-14T11:23:53.822982+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=23, tm_sec=53, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T11:25:11.326 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T11:25:31.327 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T11:25:31.467 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.464+0000 7fa3b4b40700 1 Processor -- start 2023-10-14T11:25:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.464+0000 7fa3b4b40700 1 -- start start 2023-10-14T11:25:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3b4b40700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3b015da60 0x7fa3b00c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3b4b40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b0071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3b4b40700 1 -- --> v1:172.21.15.67:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b00c5e70 con 0x7fa3b00c5a10 2023-10-14T11:25:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3b4b40700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b01624b0 con 0x7fa3b015da60 2023-10-14T11:25:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3b4b40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015de40 con 0x7fa3b006af90 2023-10-14T11:25:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3ae59c700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7fa3b015da60 0x7fa3b00c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3add9b700 1 --1- >> v1:172.21.15.67:6789/0 conn(0x7fa3b00c5a10 0x7fa3b006a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.67:6789/0 says I am v1:172.21.15.67:42928/0 (socket says 172.21.15.67:42928) 2023-10-14T11:25:31.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3add9b700 1 -- 172.21.15.67:0/1867435326 learned_addr learned my addr 172.21.15.67:0/1867435326 (peer_addr_for_me v1:172.21.15.67:0/0) 2023-10-14T11:25:31.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.465+0000 7fa3aed9d700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b0071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.473 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ae59c700 1 -- 172.21.15.67:0/1867435326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 msgr2=0x7fa3b0071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:25:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ae59c700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b0071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ae59c700 1 -- 172.21.15.67:0/1867435326 >> v1:172.21.15.67:6789/0 conn(0x7fa3b00c5a10 legacy=0x7fa3b006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.474 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ae59c700 1 -- 172.21.15.67:0/1867435326 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b01616f0 con 0x7fa3b015da60 2023-10-14T11:25:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ad59a700 1 -- 172.21.15.67:0/1867435326 <== mon.0 v1:172.21.15.67:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967154096 0 0) 0x7fa3b00c5e70 con 0x7fa3b00c5a10 2023-10-14T11:25:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ae59c700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b015da60 0x7fa3b00c54d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa398009840 tx=0x7fa398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3123c01f809a3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ad59a700 1 -- 172.21.15.67:0/1867435326 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011830 con 0x7fa3b015da60 2023-10-14T11:25:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ad59a700 1 -- 172.21.15.67:0/1867435326 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011990 con 0x7fa3b015da60 2023-10-14T11:25:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.466+0000 7fa3ad59a700 1 -- 172.21.15.67:0/1867435326 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011d20 con 0x7fa3b015da60 2023-10-14T11:25:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1867435326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b015da60 msgr2=0x7fa3b00c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b015da60 0x7fa3b00c54d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa398009840 tx=0x7fa398009b50 comp rx=0 tx=0).stop 2023-10-14T11:25:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1867435326 shutdown_connections 2023-10-14T11:25:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b0071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1867435326 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b015da60 0x7fa3b00c54d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.477 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1867435326 >> 172.21.15.67:0/1867435326 conn(0x7fa3b00d0440 msgr2=0x7fa3b00d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:31.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1867435326 shutdown_connections 2023-10-14T11:25:31.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.467+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1867435326 wait complete. 2023-10-14T11:25:31.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.468+0000 7fa3b4b40700 1 Processor -- start 2023-10-14T11:25:31.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.468+0000 7fa3b4b40700 1 -- start start 2023-10-14T11:25:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3b015da60 0x7fa3b01f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015f4e0 con 0x7fa3b00c5a10 2023-10-14T11:25:31.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015f780 con 0x7fa3b015da60 2023-10-14T11:25:31.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3b4b40700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015fa60 con 0x7fa3b006af90 2023-10-14T11:25:31.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43642/0 (socket says 172.21.15.67:43642) 2023-10-14T11:25:31.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 -- 172.21.15.67:0/1817924537 learned_addr learned my addr 172.21.15.67:0/1817924537 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:31.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3ae59c700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3aed9d700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3b015da60 0x7fa3b01f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 -- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 msgr2=0x7fa3b015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.487 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 -- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3b015da60 msgr2=0x7fa3b01f3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3b015da60 0x7fa3b01f3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.488 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.469+0000 7fa3add9b700 1 -- 172.21.15.67:0/1817924537 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980094a0 con 0x7fa3b00c5a10 2023-10-14T11:25:31.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3add9b700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c520 tx=0x7fa3a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.489 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0004c80 con 0x7fa3b00c5a10 2023-10-14T11:25:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0004de0 con 0x7fa3b00c5a10 2023-10-14T11:25:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b015fd40 con 0x7fa3b00c5a10 2023-10-14T11:25:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00072d0 con 0x7fa3b00c5a10 2023-10-14T11:25:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.470+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b015e550 con 0x7fa3b00c5a10 2023-10-14T11:25:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.471+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b004ebb0 con 0x7fa3b00c5a10 2023-10-14T11:25:31.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.471+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3a0007430 con 0x7fa3b00c5a10 2023-10-14T11:25:31.492 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.472+0000 7fa3a6ffd700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 0x7fa39006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.472+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fa3a0089160 con 0x7fa3b00c5a10 2023-10-14T11:25:31.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.472+0000 7fa3ae59c700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 0x7fa39006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.493 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.472+0000 7fa3ae59c700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 0x7fa39006d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa3980090b0 tx=0x7fa398008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.476+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3a0054280 con 0x7fa3b00c5a10 2023-10-14T11:25:31.676 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.673+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 --> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3b015e830 con 0x7fa39006af00 2023-10-14T11:25:31.685 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.682+0000 7fa3a6ffd700 1 -- 172.21.15.67:0/1817924537 <== mgr.4102 v2:172.21.15.72:6832/3280464453 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+290996 (secure 0 0 0) 0x7fa3b015e830 con 0x7fa39006af00 2023-10-14T11:25:31.689 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:25:31.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 msgr2=0x7fa39006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 0x7fa39006d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa3980090b0 tx=0x7fa398008030 comp rx=0 tx=0).stop 2023-10-14T11:25:31.692 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 msgr2=0x7fa3b01f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c520 tx=0x7fa3a000c830 comp rx=0 tx=0).stop 2023-10-14T11:25:31.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 shutdown_connections 2023-10-14T11:25:31.693 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa3b015da60 0x7fa3b01f3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7fa3b006af90 0x7fa3b015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7fa39006af00 0x7fa39006d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.694 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 --2- 172.21.15.67:0/1817924537 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7fa3b00c5a10 0x7fa3b01f3000 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.685+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 >> 172.21.15.67:0/1817924537 conn(0x7fa3b00d0440 msgr2=0x7fa3b0157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:31.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.686+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 shutdown_connections 2023-10-14T11:25:31.695 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.686+0000 7fa3b4b40700 1 -- 172.21.15.67:0/1817924537 wait complete. 2023-10-14T11:25:31.696 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2023-10-14T11:25:31.700 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-10-14T11:25:30.440115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220168,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754552,"statfs":{"total":773094113280,"available":772868661248,"internally_reserved":0,"allocated":4136960,"data_stored":2296284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003106"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.618119+0000","last_change":"2023-10-14T11:24:22.618189+0000","last_active":"2023-10-14T11:24:22.618119+0000","last_peered":"2023-10-14T11:24:22.618119+0000","last_clean":"2023-10-14T11:24:22.618119+0000","last_became_active":"2023-10-14T11:23:54.853902+0000","last_became_peered":"2023-10-14T11:23:54.853902+0000","last_unstale":"2023-10-14T11:24:22.618119+0000","last_undegraded":"2023-10-14T11:24:22.618119+0000","last_fullsized":"2023-10-14T11:24:22.618119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.618001+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.618001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:30.049607+0000","scrub_duration":0.00161269,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:04.269978+0000","last_change":"2023-10-14T11:25:04.270025+0000","last_active":"2023-10-14T11:25:04.269978+0000","last_peered":"2023-10-14T11:25:04.269978+0000","last_clean":"2023-10-14T11:25:04.269978+0000","last_became_active":"2023-10-14T11:23:54.854260+0000","last_became_peered":"2023-10-14T11:23:54.854260+0000","last_unstale":"2023-10-14T11:25:04.269978+0000","last_undegraded":"2023-10-14T11:25:04.269978+0000","last_fullsized":"2023-10-14T11:25:04.269978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:04.269866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:04.269866+0000","last_clean_scrub_stamp":"2023-10-14T11:25:04.269866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:50.707879+0000","scrub_duration":0.0016454740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:08.705675+0000","last_change":"2023-10-14T11:25:08.705724+0000","last_active":"2023-10-14T11:25:08.705675+0000","last_peered":"2023-10-14T11:25:08.705675+0000","last_clean":"2023-10-14T11:25:08.705675+0000","last_became_active":"2023-10-14T11:23:54.869964+0000","last_became_peered":"2023-10-14T11:23:54.869964+0000","last_unstale":"2023-10-14T11:25:08.705675+0000","last_undegraded":"2023-10-14T11:25:08.705675+0000","last_fullsized":"2023-10-14T11:25:08.705675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:08.705566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:08.705566+0000","last_clean_scrub_stamp":"2023-10-14T11:25:08.705566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:05.409394+0000","scrub_duration":0.001896874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:23.043768+0000","last_change":"2023-10-14T11:24:23.043816+0000","last_active":"2023-10-14T11:24:23.043768+0000","last_peered":"2023-10-14T11:24:23.043768+0000","last_clean":"2023-10-14T11:24:23.043768+0000","last_became_active":"2023-10-14T11:23:54.858535+0000","last_became_peered":"2023-10-14T11:23:54.858535+0000","last_unstale":"2023-10-14T11:24:23.043768+0000","last_undegraded":"2023-10-14T11:24:23.043768+0000","last_fullsized":"2023-10-14T11:24:23.043768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:23.043656+0000","last_clean_scrub_stamp":"2023-10-14T11:24:23.043656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:23:35.724772+0000","scrub_duration":0.0018187660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.840180+0000","last_change":"2023-10-14T11:24:30.840272+0000","last_active":"2023-10-14T11:24:30.840180+0000","last_peered":"2023-10-14T11:24:30.840180+0000","last_clean":"2023-10-14T11:24:30.840180+0000","last_became_active":"2023-10-14T11:23:54.864852+0000","last_became_peered":"2023-10-14T11:23:54.864852+0000","last_unstale":"2023-10-14T11:24:30.840180+0000","last_undegraded":"2023-10-14T11:24:30.840180+0000","last_fullsized":"2023-10-14T11:24:30.840180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.840084+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.840084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:55.609420+0000","scrub_duration":0.0012728209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:49.176613+0000","last_change":"2023-10-14T11:24:49.176665+0000","last_active":"2023-10-14T11:24:49.176613+0000","last_peered":"2023-10-14T11:24:49.176613+0000","last_clean":"2023-10-14T11:24:49.176613+0000","last_became_active":"2023-10-14T11:23:54.853188+0000","last_became_peered":"2023-10-14T11:23:54.853188+0000","last_unstale":"2023-10-14T11:24:49.176613+0000","last_undegraded":"2023-10-14T11:24:49.176613+0000","last_fullsized":"2023-10-14T11:24:49.176613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:49.176498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:49.176498+0000","last_clean_scrub_stamp":"2023-10-14T11:24:49.176498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:05:28.772654+0000","scrub_duration":0.001991994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.318224+0000","last_change":"2023-10-14T11:24:22.318269+0000","last_active":"2023-10-14T11:24:22.318224+0000","last_peered":"2023-10-14T11:24:22.318224+0000","last_clean":"2023-10-14T11:24:22.318224+0000","last_became_active":"2023-10-14T11:23:54.858381+0000","last_became_peered":"2023-10-14T11:23:54.858381+0000","last_unstale":"2023-10-14T11:24:22.318224+0000","last_undegraded":"2023-10-14T11:24:22.318224+0000","last_fullsized":"2023-10-14T11:24:22.318224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:22.318112+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.318112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:23.265011+0000","scrub_duration":0.0015173540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:37.217234+0000","last_change":"2023-10-14T11:24:37.217302+0000","last_active":"2023-10-14T11:24:37.217234+0000","last_peered":"2023-10-14T11:24:37.217234+0000","last_clean":"2023-10-14T11:24:37.217234+0000","last_became_active":"2023-10-14T11:23:54.861717+0000","last_became_peered":"2023-10-14T11:23:54.861717+0000","last_unstale":"2023-10-14T11:24:37.217234+0000","last_undegraded":"2023-10-14T11:24:37.217234+0000","last_fullsized":"2023-10-14T11:24:37.217234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:37.217072+0000","last_clean_scrub_stamp":"2023-10-14T11:24:37.217072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:25.692049+0000","scrub_duration":0.001949898,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:38.111581+0000","last_change":"2023-10-14T11:24:38.111626+0000","last_active":"2023-10-14T11:24:38.111581+0000","last_peered":"2023-10-14T11:24:38.111581+0000","last_clean":"2023-10-14T11:24:38.111581+0000","last_became_active":"2023-10-14T11:23:54.857547+0000","last_became_peered":"2023-10-14T11:23:54.857547+0000","last_unstale":"2023-10-14T11:24:38.111581+0000","last_undegraded":"2023-10-14T11:24:38.111581+0000","last_fullsized":"2023-10-14T11:24:38.111581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:38.111461+0000","last_clean_scrub_stamp":"2023-10-14T11:24:38.111461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:13.964177+0000","scrub_duration":0.0022767479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.962977+0000","last_change":"2023-10-14T11:24:35.963056+0000","last_active":"2023-10-14T11:24:35.962977+0000","last_peered":"2023-10-14T11:24:35.962977+0000","last_clean":"2023-10-14T11:24:35.962977+0000","last_became_active":"2023-10-14T11:23:54.857519+0000","last_became_peered":"2023-10-14T11:23:54.857519+0000","last_unstale":"2023-10-14T11:24:35.962977+0000","last_undegraded":"2023-10-14T11:24:35.962977+0000","last_fullsized":"2023-10-14T11:24:35.962977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.962819+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.962819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:08.610979+0000","scrub_duration":0.0016532439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:46.282432+0000","last_change":"2023-10-14T11:24:46.282500+0000","last_active":"2023-10-14T11:24:46.282432+0000","last_peered":"2023-10-14T11:24:46.282432+0000","last_clean":"2023-10-14T11:24:46.282432+0000","last_became_active":"2023-10-14T11:23:54.864457+0000","last_became_peered":"2023-10-14T11:23:54.864457+0000","last_unstale":"2023-10-14T11:24:46.282432+0000","last_undegraded":"2023-10-14T11:24:46.282432+0000","last_fullsized":"2023-10-14T11:24:46.282432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:46.282310+0000","last_clean_scrub_stamp":"2023-10-14T11:24:46.282310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:33.824008+0000","scrub_duration":0.0019801269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:52.531777+0000","last_change":"2023-10-14T11:24:52.531820+0000","last_active":"2023-10-14T11:24:52.531777+0000","last_peered":"2023-10-14T11:24:52.531777+0000","last_clean":"2023-10-14T11:24:52.531777+0000","last_became_active":"2023-10-14T11:23:54.854126+0000","last_became_peered":"2023-10-14T11:23:54.854126+0000","last_unstale":"2023-10-14T11:24:52.531777+0000","last_undegraded":"2023-10-14T11:24:52.531777+0000","last_fullsized":"2023-10-14T11:24:52.531777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:52.531669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:52.531669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:52.531669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:42:13.216196+0000","scrub_duration":0.002117196,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.652454+0000","last_change":"2023-10-14T11:24:12.652527+0000","last_active":"2023-10-14T11:24:12.652454+0000","last_peered":"2023-10-14T11:24:12.652454+0000","last_clean":"2023-10-14T11:24:12.652454+0000","last_became_active":"2023-10-14T11:23:54.860362+0000","last_became_peered":"2023-10-14T11:23:54.860362+0000","last_unstale":"2023-10-14T11:24:12.652454+0000","last_undegraded":"2023-10-14T11:24:12.652454+0000","last_fullsized":"2023-10-14T11:24:12.652454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.652307+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.652307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:57.451092+0000","scrub_duration":0.0018306030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.160848+0000","last_change":"2023-10-14T11:24:34.160901+0000","last_active":"2023-10-14T11:24:34.160848+0000","last_peered":"2023-10-14T11:24:34.160848+0000","last_clean":"2023-10-14T11:24:34.160848+0000","last_became_active":"2023-10-14T11:23:54.857268+0000","last_became_peered":"2023-10-14T11:23:54.857268+0000","last_unstale":"2023-10-14T11:24:34.160848+0000","last_undegraded":"2023-10-14T11:24:34.160848+0000","last_fullsized":"2023-10-14T11:24:34.160848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.160718+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.160718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:10.013434+0000","scrub_duration":0.001735412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:05.616491+0000","last_change":"2023-10-14T11:25:05.616564+0000","last_active":"2023-10-14T11:25:05.616491+0000","last_peered":"2023-10-14T11:25:05.616491+0000","last_clean":"2023-10-14T11:25:05.616491+0000","last_became_active":"2023-10-14T11:23:54.855734+0000","last_became_peered":"2023-10-14T11:23:54.855734+0000","last_unstale":"2023-10-14T11:25:05.616491+0000","last_undegraded":"2023-10-14T11:25:05.616491+0000","last_fullsized":"2023-10-14T11:25:05.616491+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:05.616363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:05.616363+0000","last_clean_scrub_stamp":"2023-10-14T11:25:05.616363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:42:43.683219+0000","scrub_duration":0.001633247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.280516+0000","last_change":"2023-10-14T11:24:41.280574+0000","last_active":"2023-10-14T11:24:41.280516+0000","last_peered":"2023-10-14T11:24:41.280516+0000","last_clean":"2023-10-14T11:24:41.280516+0000","last_became_active":"2023-10-14T11:23:54.855390+0000","last_became_peered":"2023-10-14T11:23:54.855390+0000","last_unstale":"2023-10-14T11:24:41.280516+0000","last_undegraded":"2023-10-14T11:24:41.280516+0000","last_fullsized":"2023-10-14T11:24:41.280516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.280409+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.280409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:19.511351+0000","scrub_duration":0.0022952070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:57.189565+0000","last_change":"2023-10-14T11:24:57.189665+0000","last_active":"2023-10-14T11:24:57.189565+0000","last_peered":"2023-10-14T11:24:57.189565+0000","last_clean":"2023-10-14T11:24:57.189565+0000","last_became_active":"2023-10-14T11:23:54.857466+0000","last_became_peered":"2023-10-14T11:23:54.857466+0000","last_unstale":"2023-10-14T11:24:57.189565+0000","last_undegraded":"2023-10-14T11:24:57.189565+0000","last_fullsized":"2023-10-14T11:24:57.189565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:57.189423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:57.189423+0000","last_clean_scrub_stamp":"2023-10-14T11:24:57.189423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:56:01.478698+0000","scrub_duration":0.0016789870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:07.197868+0000","last_change":"2023-10-14T11:25:07.197925+0000","last_active":"2023-10-14T11:25:07.197868+0000","last_peered":"2023-10-14T11:25:07.197868+0000","last_clean":"2023-10-14T11:25:07.197868+0000","last_became_active":"2023-10-14T11:23:54.856766+0000","last_became_peered":"2023-10-14T11:23:54.856766+0000","last_unstale":"2023-10-14T11:25:07.197868+0000","last_undegraded":"2023-10-14T11:25:07.197868+0000","last_fullsized":"2023-10-14T11:25:07.197868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:07.197737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:07.197737+0000","last_clean_scrub_stamp":"2023-10-14T11:25:07.197737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:57:35.695543+0000","scrub_duration":0.001670132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:03.279118+0000","last_change":"2023-10-14T11:25:03.279167+0000","last_active":"2023-10-14T11:25:03.279118+0000","last_peered":"2023-10-14T11:25:03.279118+0000","last_clean":"2023-10-14T11:25:03.279118+0000","last_became_active":"2023-10-14T11:23:54.850697+0000","last_became_peered":"2023-10-14T11:23:54.850697+0000","last_unstale":"2023-10-14T11:25:03.279118+0000","last_undegraded":"2023-10-14T11:25:03.279118+0000","last_fullsized":"2023-10-14T11:25:03.279118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:03.278991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:03.278991+0000","last_clean_scrub_stamp":"2023-10-14T11:25:03.278991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:21.571443+0000","scrub_duration":0.001784311,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.818675+0000","last_change":"2023-10-14T11:24:31.818741+0000","last_active":"2023-10-14T11:24:31.818675+0000","last_peered":"2023-10-14T11:24:31.818675+0000","last_clean":"2023-10-14T11:24:31.818675+0000","last_became_active":"2023-10-14T11:23:54.861841+0000","last_became_peered":"2023-10-14T11:23:54.861841+0000","last_unstale":"2023-10-14T11:24:31.818675+0000","last_undegraded":"2023-10-14T11:24:31.818675+0000","last_fullsized":"2023-10-14T11:24:31.818675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.818485+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.818485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:03.752400+0000","scrub_duration":0.0019508419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:29.933981+0000","last_change":"2023-10-14T11:24:29.934042+0000","last_active":"2023-10-14T11:24:29.933981+0000","last_peered":"2023-10-14T11:24:29.933981+0000","last_clean":"2023-10-14T11:24:29.933981+0000","last_became_active":"2023-10-14T11:23:54.860586+0000","last_became_peered":"2023-10-14T11:23:54.860586+0000","last_unstale":"2023-10-14T11:24:29.933981+0000","last_undegraded":"2023-10-14T11:24:29.933981+0000","last_fullsized":"2023-10-14T11:24:29.933981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:29.933851+0000","last_clean_scrub_stamp":"2023-10-14T11:24:29.933851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:12.764047+0000","scrub_duration":0.0021874860000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:53.389266+0000","last_change":"2023-10-14T11:24:53.389331+0000","last_active":"2023-10-14T11:24:53.389266+0000","last_peered":"2023-10-14T11:24:53.389266+0000","last_clean":"2023-10-14T11:24:53.389266+0000","last_became_active":"2023-10-14T11:23:54.856371+0000","last_became_peered":"2023-10-14T11:23:54.856371+0000","last_unstale":"2023-10-14T11:24:53.389266+0000","last_undegraded":"2023-10-14T11:24:53.389266+0000","last_fullsized":"2023-10-14T11:24:53.389266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:53.389151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:53.389151+0000","last_clean_scrub_stamp":"2023-10-14T11:24:53.389151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:50.092980+0000","scrub_duration":0.002148708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.380454+0000","last_change":"2023-10-14T11:24:17.380528+0000","last_active":"2023-10-14T11:24:17.380454+0000","last_peered":"2023-10-14T11:24:17.380454+0000","last_clean":"2023-10-14T11:24:17.380454+0000","last_became_active":"2023-10-14T11:23:54.853180+0000","last_became_peered":"2023-10-14T11:23:54.853180+0000","last_unstale":"2023-10-14T11:24:17.380454+0000","last_undegraded":"2023-10-14T11:24:17.380454+0000","last_fullsized":"2023-10-14T11:24:17.380454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.380311+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.380311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:22:49.314225+0000","scrub_duration":0.0020088469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.649868+0000","last_change":"2023-10-14T11:24:25.649924+0000","last_active":"2023-10-14T11:24:25.649868+0000","last_peered":"2023-10-14T11:24:25.649868+0000","last_clean":"2023-10-14T11:24:25.649868+0000","last_became_active":"2023-10-14T11:23:54.861783+0000","last_became_peered":"2023-10-14T11:23:54.861783+0000","last_unstale":"2023-10-14T11:24:25.649868+0000","last_undegraded":"2023-10-14T11:24:25.649868+0000","last_fullsized":"2023-10-14T11:24:25.649868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.649757+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.649757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:50.342876+0000","scrub_duration":0.001768936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.032513+0000","last_change":"2023-10-14T11:24:24.032590+0000","last_active":"2023-10-14T11:24:24.032513+0000","last_peered":"2023-10-14T11:24:24.032513+0000","last_clean":"2023-10-14T11:24:24.032513+0000","last_became_active":"2023-10-14T11:23:54.853417+0000","last_became_peered":"2023-10-14T11:23:54.853417+0000","last_unstale":"2023-10-14T11:24:24.032513+0000","last_undegraded":"2023-10-14T11:24:24.032513+0000","last_fullsized":"2023-10-14T11:24:24.032513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.032364+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.032364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:37:49.045417+0000","scrub_duration":0.0021628229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:50.213808+0000","last_change":"2023-10-14T11:24:50.213887+0000","last_active":"2023-10-14T11:24:50.213808+0000","last_peered":"2023-10-14T11:24:50.213808+0000","last_clean":"2023-10-14T11:24:50.213808+0000","last_became_active":"2023-10-14T11:23:54.852588+0000","last_became_peered":"2023-10-14T11:23:54.852588+0000","last_unstale":"2023-10-14T11:24:50.213808+0000","last_undegraded":"2023-10-14T11:24:50.213808+0000","last_fullsized":"2023-10-14T11:24:50.213808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:50.213649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:50.213649+0000","last_clean_scrub_stamp":"2023-10-14T11:24:50.213649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:45:56.907951+0000","scrub_duration":0.0020373320000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.050980+0000","last_change":"2023-10-14T11:24:34.051034+0000","last_active":"2023-10-14T11:24:34.050980+0000","last_peered":"2023-10-14T11:24:34.050980+0000","last_clean":"2023-10-14T11:24:34.050980+0000","last_became_active":"2023-10-14T11:23:54.859744+0000","last_became_peered":"2023-10-14T11:23:54.859744+0000","last_unstale":"2023-10-14T11:24:34.050980+0000","last_undegraded":"2023-10-14T11:24:34.050980+0000","last_fullsized":"2023-10-14T11:24:34.050980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.050856+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.050856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:23.081327+0000","scrub_duration":0.0022522530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:41.610958+0000","last_change":"2023-10-14T11:24:41.611049+0000","last_active":"2023-10-14T11:24:41.610958+0000","last_peered":"2023-10-14T11:24:41.610958+0000","last_clean":"2023-10-14T11:24:41.610958+0000","last_became_active":"2023-10-14T11:23:54.853093+0000","last_became_peered":"2023-10-14T11:23:54.853093+0000","last_unstale":"2023-10-14T11:24:41.610958+0000","last_undegraded":"2023-10-14T11:24:41.610958+0000","last_fullsized":"2023-10-14T11:24:41.610958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:41.610843+0000","last_clean_scrub_stamp":"2023-10-14T11:24:41.610843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:53.135545+0000","scrub_duration":0.0021190929999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:28.969856+0000","last_change":"2023-10-14T11:24:28.969918+0000","last_active":"2023-10-14T11:24:28.969856+0000","last_peered":"2023-10-14T11:24:28.969856+0000","last_clean":"2023-10-14T11:24:28.969856+0000","last_became_active":"2023-10-14T11:23:54.854700+0000","last_became_peered":"2023-10-14T11:23:54.854700+0000","last_unstale":"2023-10-14T11:24:28.969856+0000","last_undegraded":"2023-10-14T11:24:28.969856+0000","last_fullsized":"2023-10-14T11:24:28.969856+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:28.969745+0000","last_clean_scrub_stamp":"2023-10-14T11:24:28.969745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:39:57.115286+0000","scrub_duration":0.0020373919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.293416+0000","last_change":"2023-10-14T11:24:35.293463+0000","last_active":"2023-10-14T11:24:35.293416+0000","last_peered":"2023-10-14T11:24:35.293416+0000","last_clean":"2023-10-14T11:24:35.293416+0000","last_became_active":"2023-10-14T11:23:54.857362+0000","last_became_peered":"2023-10-14T11:23:54.857362+0000","last_unstale":"2023-10-14T11:24:35.293416+0000","last_undegraded":"2023-10-14T11:24:35.293416+0000","last_fullsized":"2023-10-14T11:24:35.293416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.293296+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.293296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:24.323767+0000","scrub_duration":0.0014562679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.612889+0000","last_change":"2023-10-14T11:24:19.612977+0000","last_active":"2023-10-14T11:24:19.612889+0000","last_peered":"2023-10-14T11:24:19.612889+0000","last_clean":"2023-10-14T11:24:19.612889+0000","last_became_active":"2023-10-14T11:23:54.862210+0000","last_became_peered":"2023-10-14T11:23:54.862210+0000","last_unstale":"2023-10-14T11:24:19.612889+0000","last_undegraded":"2023-10-14T11:24:19.612889+0000","last_fullsized":"2023-10-14T11:24:19.612889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:19.612775+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.612775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:28.923551+0000","scrub_duration":0.0020682040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.353591+0000","last_change":"2023-10-14T11:24:18.353635+0000","last_active":"2023-10-14T11:24:18.353591+0000","last_peered":"2023-10-14T11:24:18.353591+0000","last_clean":"2023-10-14T11:24:18.353591+0000","last_became_active":"2023-10-14T11:23:54.858291+0000","last_became_peered":"2023-10-14T11:23:54.858291+0000","last_unstale":"2023-10-14T11:24:18.353591+0000","last_undegraded":"2023-10-14T11:24:18.353591+0000","last_fullsized":"2023-10-14T11:24:18.353591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.353458+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.353458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:12.119177+0000","scrub_duration":0.001475496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.371536+0000","last_change":"2023-10-14T11:24:26.371583+0000","last_active":"2023-10-14T11:24:26.371536+0000","last_peered":"2023-10-14T11:24:26.371536+0000","last_clean":"2023-10-14T11:24:26.371536+0000","last_became_active":"2023-10-14T11:23:54.856840+0000","last_became_peered":"2023-10-14T11:23:54.856840+0000","last_unstale":"2023-10-14T11:24:26.371536+0000","last_undegraded":"2023-10-14T11:24:26.371536+0000","last_fullsized":"2023-10-14T11:24:26.371536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:26.371421+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.371421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:10.031597+0000","scrub_duration":0.002261239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.572146+0000","last_change":"2023-10-14T11:24:12.572201+0000","last_active":"2023-10-14T11:24:12.572146+0000","last_peered":"2023-10-14T11:24:12.572146+0000","last_clean":"2023-10-14T11:24:12.572146+0000","last_became_active":"2023-10-14T11:23:53.838670+0000","last_became_peered":"2023-10-14T11:23:53.838670+0000","last_unstale":"2023-10-14T11:24:12.572146+0000","last_undegraded":"2023-10-14T11:24:12.572146+0000","last_fullsized":"2023-10-14T11:24:12.572146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-10-14T11:24:12.572029+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.572029+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:05.536861+0000","scrub_duration":0.0021884140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.588810+0000","last_change":"2023-10-14T11:24:20.588873+0000","last_active":"2023-10-14T11:24:20.588810+0000","last_peered":"2023-10-14T11:24:20.588810+0000","last_clean":"2023-10-14T11:24:20.588810+0000","last_became_active":"2023-10-14T11:23:54.858120+0000","last_became_peered":"2023-10-14T11:23:54.858120+0000","last_unstale":"2023-10-14T11:24:20.588810+0000","last_undegraded":"2023-10-14T11:24:20.588810+0000","last_fullsized":"2023-10-14T11:24:20.588810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.588675+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.588675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:49.622214+0000","scrub_duration":0.0016745919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.359903+0000","last_change":"2023-10-14T11:24:16.359975+0000","last_active":"2023-10-14T11:24:16.359903+0000","last_peered":"2023-10-14T11:24:16.359903+0000","last_clean":"2023-10-14T11:24:16.359903+0000","last_became_active":"2023-10-14T11:23:53.846138+0000","last_became_peered":"2023-10-14T11:23:53.846138+0000","last_unstale":"2023-10-14T11:24:16.359903+0000","last_undegraded":"2023-10-14T11:24:16.359903+0000","last_fullsized":"2023-10-14T11:24:16.359903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:16.359793+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.359793+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:45:41.129129+0000","scrub_duration":0.002300818,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:55.365667+0000","last_change":"2023-10-14T11:24:55.365748+0000","last_active":"2023-10-14T11:24:55.365667+0000","last_peered":"2023-10-14T11:24:55.365667+0000","last_clean":"2023-10-14T11:24:55.365667+0000","last_became_active":"2023-10-14T11:23:54.858132+0000","last_became_peered":"2023-10-14T11:23:54.858132+0000","last_unstale":"2023-10-14T11:24:55.365667+0000","last_undegraded":"2023-10-14T11:24:55.365667+0000","last_fullsized":"2023-10-14T11:24:55.365667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:55.365553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:55.365553+0000","last_clean_scrub_stamp":"2023-10-14T11:24:55.365553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:09:45.835100+0000","scrub_duration":0.0022324699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.224194+0000","last_change":"2023-10-14T11:24:25.224252+0000","last_active":"2023-10-14T11:24:25.224194+0000","last_peered":"2023-10-14T11:24:25.224194+0000","last_clean":"2023-10-14T11:24:25.224194+0000","last_became_active":"2023-10-14T11:23:53.848618+0000","last_became_peered":"2023-10-14T11:23:53.848618+0000","last_unstale":"2023-10-14T11:24:25.224194+0000","last_undegraded":"2023-10-14T11:24:25.224194+0000","last_fullsized":"2023-10-14T11:24:25.224194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:25.224080+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.224080+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:08.054276+0000","scrub_duration":0.0030700860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:30.938216+0000","last_change":"2023-10-14T11:24:30.938255+0000","last_active":"2023-10-14T11:24:30.938216+0000","last_peered":"2023-10-14T11:24:30.938216+0000","last_clean":"2023-10-14T11:24:30.938216+0000","last_became_active":"2023-10-14T11:23:54.859041+0000","last_became_peered":"2023-10-14T11:23:54.859041+0000","last_unstale":"2023-10-14T11:24:30.938216+0000","last_undegraded":"2023-10-14T11:24:30.938216+0000","last_fullsized":"2023-10-14T11:24:30.938216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:30.938126+0000","last_clean_scrub_stamp":"2023-10-14T11:24:30.938126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:12:42.687486+0000","scrub_duration":0.0018420349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.657769+0000","last_change":"2023-10-14T11:24:10.657818+0000","last_active":"2023-10-14T11:24:10.657769+0000","last_peered":"2023-10-14T11:24:10.657769+0000","last_clean":"2023-10-14T11:24:10.657769+0000","last_became_active":"2023-10-14T11:23:53.849883+0000","last_became_peered":"2023-10-14T11:23:53.849883+0000","last_unstale":"2023-10-14T11:24:10.657769+0000","last_undegraded":"2023-10-14T11:24:10.657769+0000","last_fullsized":"2023-10-14T11:24:10.657769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:10.657669+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.657669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:38:51.690631+0000","scrub_duration":0.0017120919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:49.204817+0000","last_change":"2023-10-14T11:24:49.204864+0000","last_active":"2023-10-14T11:24:49.204817+0000","last_peered":"2023-10-14T11:24:49.204817+0000","last_clean":"2023-10-14T11:24:49.204817+0000","last_became_active":"2023-10-14T11:23:54.861355+0000","last_became_peered":"2023-10-14T11:23:54.861355+0000","last_unstale":"2023-10-14T11:24:49.204817+0000","last_undegraded":"2023-10-14T11:24:49.204817+0000","last_fullsized":"2023-10-14T11:24:49.204817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:49.204714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:49.204714+0000","last_clean_scrub_stamp":"2023-10-14T11:24:49.204714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:25.057430+0000","scrub_duration":0.001618186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.955178+0000","last_change":"2023-10-14T11:24:22.955233+0000","last_active":"2023-10-14T11:24:22.955178+0000","last_peered":"2023-10-14T11:24:22.955178+0000","last_clean":"2023-10-14T11:24:22.955178+0000","last_became_active":"2023-10-14T11:23:53.841455+0000","last_became_peered":"2023-10-14T11:23:53.841455+0000","last_unstale":"2023-10-14T11:24:22.955178+0000","last_undegraded":"2023-10-14T11:24:22.955178+0000","last_fullsized":"2023-10-14T11:24:22.955178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:22.955060+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.955060+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:16.720779+0000","scrub_duration":0.0019597210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:50.513923+0000","last_change":"2023-10-14T11:24:50.514004+0000","last_active":"2023-10-14T11:24:50.513923+0000","last_peered":"2023-10-14T11:24:50.513923+0000","last_clean":"2023-10-14T11:24:50.513923+0000","last_became_active":"2023-10-14T11:23:54.866747+0000","last_became_peered":"2023-10-14T11:23:54.866747+0000","last_unstale":"2023-10-14T11:24:50.513923+0000","last_undegraded":"2023-10-14T11:24:50.513923+0000","last_fullsized":"2023-10-14T11:24:50.513923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:50.513795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:50.513795+0000","last_clean_scrub_stamp":"2023-10-14T11:24:50.513795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:28.744737+0000","scrub_duration":0.002022341,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:19.031156+0000","last_change":"2023-10-14T11:24:19.031223+0000","last_active":"2023-10-14T11:24:19.031156+0000","last_peered":"2023-10-14T11:24:19.031156+0000","last_clean":"2023-10-14T11:24:19.031156+0000","last_became_active":"2023-10-14T11:23:53.841699+0000","last_became_peered":"2023-10-14T11:23:53.841699+0000","last_unstale":"2023-10-14T11:24:19.031156+0000","last_undegraded":"2023-10-14T11:24:19.031156+0000","last_fullsized":"2023-10-14T11:24:19.031156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:19.031043+0000","last_clean_scrub_stamp":"2023-10-14T11:24:19.031043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:14.404949+0000","scrub_duration":0.002047484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:31.938331+0000","last_change":"2023-10-14T11:24:31.938378+0000","last_active":"2023-10-14T11:24:31.938331+0000","last_peered":"2023-10-14T11:24:31.938331+0000","last_clean":"2023-10-14T11:24:31.938331+0000","last_became_active":"2023-10-14T11:23:54.854630+0000","last_became_peered":"2023-10-14T11:23:54.854630+0000","last_unstale":"2023-10-14T11:24:31.938331+0000","last_undegraded":"2023-10-14T11:24:31.938331+0000","last_fullsized":"2023-10-14T11:24:31.938331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:31.938227+0000","last_clean_scrub_stamp":"2023-10-14T11:24:31.938227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:41:52.622754+0000","scrub_duration":0.00144428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.033528+0000","last_change":"2023-10-14T11:24:16.033579+0000","last_active":"2023-10-14T11:24:16.033528+0000","last_peered":"2023-10-14T11:24:16.033528+0000","last_clean":"2023-10-14T11:24:16.033528+0000","last_became_active":"2023-10-14T11:23:53.848138+0000","last_became_peered":"2023-10-14T11:23:53.848138+0000","last_unstale":"2023-10-14T11:24:16.033528+0000","last_undegraded":"2023-10-14T11:24:16.033528+0000","last_fullsized":"2023-10-14T11:24:16.033528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.033420+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.033420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:16.980319+0000","scrub_duration":0.0015776,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:35.007336+0000","last_change":"2023-10-14T11:24:35.007399+0000","last_active":"2023-10-14T11:24:35.007336+0000","last_peered":"2023-10-14T11:24:35.007336+0000","last_clean":"2023-10-14T11:24:35.007336+0000","last_became_active":"2023-10-14T11:23:54.854466+0000","last_became_peered":"2023-10-14T11:23:54.854466+0000","last_unstale":"2023-10-14T11:24:35.007336+0000","last_undegraded":"2023-10-14T11:24:35.007336+0000","last_fullsized":"2023-10-14T11:24:35.007336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:35.007224+0000","last_clean_scrub_stamp":"2023-10-14T11:24:35.007224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:16:23.482201+0000","scrub_duration":0.0022040940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.918317+0000","last_change":"2023-10-14T11:24:12.918415+0000","last_active":"2023-10-14T11:24:12.918317+0000","last_peered":"2023-10-14T11:24:12.918317+0000","last_clean":"2023-10-14T11:24:12.918317+0000","last_became_active":"2023-10-14T11:23:53.835707+0000","last_became_peered":"2023-10-14T11:23:53.835707+0000","last_unstale":"2023-10-14T11:24:12.918317+0000","last_undegraded":"2023-10-14T11:24:12.918317+0000","last_fullsized":"2023-10-14T11:24:12.918317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:12.918195+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.918195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:26:41.951734+0000","scrub_duration":0.001509102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:00.483927+0000","last_change":"2023-10-14T11:25:00.483978+0000","last_active":"2023-10-14T11:25:00.483927+0000","last_peered":"2023-10-14T11:25:00.483927+0000","last_clean":"2023-10-14T11:25:00.483927+0000","last_became_active":"2023-10-14T11:23:54.862993+0000","last_became_peered":"2023-10-14T11:23:54.862993+0000","last_unstale":"2023-10-14T11:25:00.483927+0000","last_undegraded":"2023-10-14T11:25:00.483927+0000","last_fullsized":"2023-10-14T11:25:00.483927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:00.483812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:00.483812+0000","last_clean_scrub_stamp":"2023-10-14T11:25:00.483812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:57:36.336529+0000","scrub_duration":0.002013468,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.117423+0000","last_change":"2023-10-14T11:24:20.117501+0000","last_active":"2023-10-14T11:24:20.117423+0000","last_peered":"2023-10-14T11:24:20.117423+0000","last_clean":"2023-10-14T11:24:20.117423+0000","last_became_active":"2023-10-14T11:23:53.846148+0000","last_became_peered":"2023-10-14T11:23:53.846148+0000","last_unstale":"2023-10-14T11:24:20.117423+0000","last_undegraded":"2023-10-14T11:24:20.117423+0000","last_fullsized":"2023-10-14T11:24:20.117423+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.117283+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.117283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:00:09.147754+0000","scrub_duration":0.002212463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:58.253646+0000","last_change":"2023-10-14T11:24:58.253697+0000","last_active":"2023-10-14T11:24:58.253646+0000","last_peered":"2023-10-14T11:24:58.253646+0000","last_clean":"2023-10-14T11:24:58.253646+0000","last_became_active":"2023-10-14T11:23:54.856848+0000","last_became_peered":"2023-10-14T11:23:54.856848+0000","last_unstale":"2023-10-14T11:24:58.253646+0000","last_undegraded":"2023-10-14T11:24:58.253646+0000","last_fullsized":"2023-10-14T11:24:58.253646+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:58.253521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:58.253521+0000","last_clean_scrub_stamp":"2023-10-14T11:24:58.253521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:12:27.287553+0000","scrub_duration":0.0015270069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.367700+0000","last_change":"2023-10-14T11:24:15.367749+0000","last_active":"2023-10-14T11:24:15.367700+0000","last_peered":"2023-10-14T11:24:15.367700+0000","last_clean":"2023-10-14T11:24:15.367700+0000","last_became_active":"2023-10-14T11:23:53.848636+0000","last_became_peered":"2023-10-14T11:23:53.848636+0000","last_unstale":"2023-10-14T11:24:15.367700+0000","last_undegraded":"2023-10-14T11:24:15.367700+0000","last_fullsized":"2023-10-14T11:24:15.367700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.367586+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.367586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:36.189165+0000","scrub_duration":0.001682048,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.001748+0000","last_change":"2023-10-14T11:24:10.001813+0000","last_active":"2023-10-14T11:24:10.001748+0000","last_peered":"2023-10-14T11:24:10.001748+0000","last_clean":"2023-10-14T11:24:10.001748+0000","last_became_active":"2023-10-14T11:23:54.852380+0000","last_became_peered":"2023-10-14T11:23:54.852380+0000","last_unstale":"2023-10-14T11:24:10.001748+0000","last_undegraded":"2023-10-14T11:24:10.001748+0000","last_fullsized":"2023-10-14T11:24:10.001748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.001627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.001627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:51.478987+0000","scrub_duration":0.001776112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:22.629817+0000","last_change":"2023-10-14T11:24:22.629870+0000","last_active":"2023-10-14T11:24:22.629817+0000","last_peered":"2023-10-14T11:24:22.629817+0000","last_clean":"2023-10-14T11:24:22.629817+0000","last_became_active":"2023-10-14T11:23:53.845075+0000","last_became_peered":"2023-10-14T11:23:53.845075+0000","last_unstale":"2023-10-14T11:24:22.629817+0000","last_undegraded":"2023-10-14T11:24:22.629817+0000","last_fullsized":"2023-10-14T11:24:22.629817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-10-14T11:24:22.629697+0000","last_clean_scrub_stamp":"2023-10-14T11:24:22.629697+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:57:04.107057+0000","scrub_duration":0.0021629869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:07.675293+0000","last_change":"2023-10-14T11:25:07.675341+0000","last_active":"2023-10-14T11:25:07.675293+0000","last_peered":"2023-10-14T11:25:07.675293+0000","last_clean":"2023-10-14T11:25:07.675293+0000","last_became_active":"2023-10-14T11:23:54.869882+0000","last_became_peered":"2023-10-14T11:23:54.869882+0000","last_unstale":"2023-10-14T11:25:07.675293+0000","last_undegraded":"2023-10-14T11:25:07.675293+0000","last_fullsized":"2023-10-14T11:25:07.675293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:07.675175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:07.675175+0000","last_clean_scrub_stamp":"2023-10-14T11:25:07.675175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:47:01.688381+0000","scrub_duration":0.0020553379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:14.989113+0000","last_change":"2023-10-14T11:24:14.989170+0000","last_active":"2023-10-14T11:24:14.989113+0000","last_peered":"2023-10-14T11:24:14.989113+0000","last_clean":"2023-10-14T11:24:14.989113+0000","last_became_active":"2023-10-14T11:23:53.844396+0000","last_became_peered":"2023-10-14T11:23:53.844396+0000","last_unstale":"2023-10-14T11:24:14.989113+0000","last_undegraded":"2023-10-14T11:24:14.989113+0000","last_fullsized":"2023-10-14T11:24:14.989113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-10-14T11:24:14.988999+0000","last_clean_scrub_stamp":"2023-10-14T11:24:14.988999+0000","objects_scrubbed":4,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:02:08.754718+0000","scrub_duration":0.0030364979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.174066+0000","last_change":"2023-10-14T11:24:18.174117+0000","last_active":"2023-10-14T11:24:18.174066+0000","last_peered":"2023-10-14T11:24:18.174066+0000","last_clean":"2023-10-14T11:24:18.174066+0000","last_became_active":"2023-10-14T11:23:54.854422+0000","last_became_peered":"2023-10-14T11:23:54.854422+0000","last_unstale":"2023-10-14T11:24:18.174066+0000","last_undegraded":"2023-10-14T11:24:18.174066+0000","last_fullsized":"2023-10-14T11:24:18.174066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.173944+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.173944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:01.834121+0000","scrub_duration":0.0025641790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.947992+0000","last_change":"2023-10-14T11:24:13.948045+0000","last_active":"2023-10-14T11:24:13.947992+0000","last_peered":"2023-10-14T11:24:13.947992+0000","last_clean":"2023-10-14T11:24:13.947992+0000","last_became_active":"2023-10-14T11:23:53.836505+0000","last_became_peered":"2023-10-14T11:23:53.836505+0000","last_unstale":"2023-10-14T11:24:13.947992+0000","last_undegraded":"2023-10-14T11:24:13.947992+0000","last_fullsized":"2023-10-14T11:24:13.947992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:13.947888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.947888+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:11.579179+0000","scrub_duration":0.002298937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:45.115302+0000","last_change":"2023-10-14T11:24:45.115354+0000","last_active":"2023-10-14T11:24:45.115302+0000","last_peered":"2023-10-14T11:24:45.115302+0000","last_clean":"2023-10-14T11:24:45.115302+0000","last_became_active":"2023-10-14T11:23:54.851779+0000","last_became_peered":"2023-10-14T11:23:54.851779+0000","last_unstale":"2023-10-14T11:24:45.115302+0000","last_undegraded":"2023-10-14T11:24:45.115302+0000","last_fullsized":"2023-10-14T11:24:45.115302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:45.115192+0000","last_clean_scrub_stamp":"2023-10-14T11:24:45.115192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:41.051192+0000","scrub_duration":0.001751362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.193107+0000","last_change":"2023-10-14T11:24:15.193158+0000","last_active":"2023-10-14T11:24:15.193107+0000","last_peered":"2023-10-14T11:24:15.193107+0000","last_clean":"2023-10-14T11:24:15.193107+0000","last_became_active":"2023-10-14T11:23:53.832834+0000","last_became_peered":"2023-10-14T11:23:53.832834+0000","last_unstale":"2023-10-14T11:24:15.193107+0000","last_undegraded":"2023-10-14T11:24:15.193107+0000","last_fullsized":"2023-10-14T11:24:15.193107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.193011+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.193011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:20:15.570002+0000","scrub_duration":0.0020719250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:54.188065+0000","last_change":"2023-10-14T11:24:54.188157+0000","last_active":"2023-10-14T11:24:54.188065+0000","last_peered":"2023-10-14T11:24:54.188065+0000","last_clean":"2023-10-14T11:24:54.188065+0000","last_became_active":"2023-10-14T11:23:54.859636+0000","last_became_peered":"2023-10-14T11:23:54.859636+0000","last_unstale":"2023-10-14T11:24:54.188065+0000","last_undegraded":"2023-10-14T11:24:54.188065+0000","last_fullsized":"2023-10-14T11:24:54.188065+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:54.187946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:54.187946+0000","last_clean_scrub_stamp":"2023-10-14T11:24:54.187946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:25:55.517868+0000","scrub_duration":0.001521131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.075214+0000","last_change":"2023-10-14T11:24:18.075260+0000","last_active":"2023-10-14T11:24:18.075214+0000","last_peered":"2023-10-14T11:24:18.075214+0000","last_clean":"2023-10-14T11:24:18.075214+0000","last_became_active":"2023-10-14T11:23:53.846565+0000","last_became_peered":"2023-10-14T11:23:53.846565+0000","last_unstale":"2023-10-14T11:24:18.075214+0000","last_undegraded":"2023-10-14T11:24:18.075214+0000","last_fullsized":"2023-10-14T11:24:18.075214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.075105+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.075105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:57:07.333526+0000","scrub_duration":0.0020020939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.600778+0000","last_change":"2023-10-14T11:24:18.600826+0000","last_active":"2023-10-14T11:24:18.600778+0000","last_peered":"2023-10-14T11:24:18.600778+0000","last_clean":"2023-10-14T11:24:18.600778+0000","last_became_active":"2023-10-14T11:23:54.859310+0000","last_became_peered":"2023-10-14T11:23:54.859310+0000","last_unstale":"2023-10-14T11:24:18.600778+0000","last_undegraded":"2023-10-14T11:24:18.600778+0000","last_fullsized":"2023-10-14T11:24:18.600778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.600643+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.600643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:39.422221+0000","scrub_duration":0.001627075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.039119+0000","last_change":"2023-10-14T11:24:17.039213+0000","last_active":"2023-10-14T11:24:17.039119+0000","last_peered":"2023-10-14T11:24:17.039119+0000","last_clean":"2023-10-14T11:24:17.039119+0000","last_became_active":"2023-10-14T11:23:53.842594+0000","last_became_peered":"2023-10-14T11:23:53.842594+0000","last_unstale":"2023-10-14T11:24:17.039119+0000","last_undegraded":"2023-10-14T11:24:17.039119+0000","last_fullsized":"2023-10-14T11:24:17.039119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'8","last_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_deep_scrub":"31'8","last_deep_scrub_stamp":"2023-10-14T11:24:17.038941+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.038941+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:35.598811+0000","scrub_duration":0.0024319699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:27.919753+0000","last_change":"2023-10-14T11:24:27.919799+0000","last_active":"2023-10-14T11:24:27.919753+0000","last_peered":"2023-10-14T11:24:27.919753+0000","last_clean":"2023-10-14T11:24:27.919753+0000","last_became_active":"2023-10-14T11:23:54.853098+0000","last_became_peered":"2023-10-14T11:23:54.853098+0000","last_unstale":"2023-10-14T11:24:27.919753+0000","last_undegraded":"2023-10-14T11:24:27.919753+0000","last_fullsized":"2023-10-14T11:24:27.919753+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:27.919641+0000","last_clean_scrub_stamp":"2023-10-14T11:24:27.919641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:45:39.444343+0000","scrub_duration":0.001583232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:07.216148+0000","last_change":"2023-10-14T11:24:07.216215+0000","last_active":"2023-10-14T11:24:07.216148+0000","last_peered":"2023-10-14T11:24:07.216148+0000","last_clean":"2023-10-14T11:24:07.216148+0000","last_became_active":"2023-10-14T11:23:53.837845+0000","last_became_peered":"2023-10-14T11:23:53.837845+0000","last_unstale":"2023-10-14T11:24:07.216148+0000","last_undegraded":"2023-10-14T11:24:07.216148+0000","last_fullsized":"2023-10-14T11:24:07.216148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:07.216014+0000","last_clean_scrub_stamp":"2023-10-14T11:24:07.216014+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:30:28.037593+0000","scrub_duration":0.001805564,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:48.517995+0000","last_change":"2023-10-14T11:24:48.518043+0000","last_active":"2023-10-14T11:24:48.517995+0000","last_peered":"2023-10-14T11:24:48.517995+0000","last_clean":"2023-10-14T11:24:48.517995+0000","last_became_active":"2023-10-14T11:23:54.858658+0000","last_became_peered":"2023-10-14T11:23:54.858658+0000","last_unstale":"2023-10-14T11:24:48.517995+0000","last_undegraded":"2023-10-14T11:24:48.517995+0000","last_fullsized":"2023-10-14T11:24:48.517995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:48.517888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:48.517888+0000","last_clean_scrub_stamp":"2023-10-14T11:24:48.517888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:27:31.348083+0000","scrub_duration":0.001589675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:26.928168+0000","last_change":"2023-10-14T11:24:26.928221+0000","last_active":"2023-10-14T11:24:26.928168+0000","last_peered":"2023-10-14T11:24:26.928168+0000","last_clean":"2023-10-14T11:24:26.928168+0000","last_became_active":"2023-10-14T11:23:53.836675+0000","last_became_peered":"2023-10-14T11:23:53.836675+0000","last_unstale":"2023-10-14T11:24:26.928168+0000","last_undegraded":"2023-10-14T11:24:26.928168+0000","last_fullsized":"2023-10-14T11:24:26.928168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-10-14T11:24:26.928047+0000","last_clean_scrub_stamp":"2023-10-14T11:24:26.928047+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:10:45.487917+0000","scrub_duration":0.002943017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:36.993836+0000","last_change":"2023-10-14T11:24:36.993895+0000","last_active":"2023-10-14T11:24:36.993836+0000","last_peered":"2023-10-14T11:24:36.993836+0000","last_clean":"2023-10-14T11:24:36.993836+0000","last_became_active":"2023-10-14T11:23:54.859554+0000","last_became_peered":"2023-10-14T11:23:54.859554+0000","last_unstale":"2023-10-14T11:24:36.993836+0000","last_undegraded":"2023-10-14T11:24:36.993836+0000","last_fullsized":"2023-10-14T11:24:36.993836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:36.993722+0000","last_clean_scrub_stamp":"2023-10-14T11:24:36.993722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:33:40.645496+0000","scrub_duration":0.0019673289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.964012+0000","last_change":"2023-10-14T11:24:11.964066+0000","last_active":"2023-10-14T11:24:11.964012+0000","last_peered":"2023-10-14T11:24:11.964012+0000","last_clean":"2023-10-14T11:24:11.964012+0000","last_became_active":"2023-10-14T11:23:53.850191+0000","last_became_peered":"2023-10-14T11:23:53.850191+0000","last_unstale":"2023-10-14T11:24:11.964012+0000","last_undegraded":"2023-10-14T11:24:11.964012+0000","last_fullsized":"2023-10-14T11:24:11.964012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'1","last_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_deep_scrub":"31'1","last_deep_scrub_stamp":"2023-10-14T11:24:11.963898+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.963898+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:00.000285+0000","scrub_duration":0.0025292790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.776905+0000","last_change":"2023-10-14T11:24:32.776965+0000","last_active":"2023-10-14T11:24:32.776905+0000","last_peered":"2023-10-14T11:24:32.776905+0000","last_clean":"2023-10-14T11:24:32.776905+0000","last_became_active":"2023-10-14T11:23:54.866637+0000","last_became_peered":"2023-10-14T11:23:54.866637+0000","last_unstale":"2023-10-14T11:24:32.776905+0000","last_undegraded":"2023-10-14T11:24:32.776905+0000","last_fullsized":"2023-10-14T11:24:32.776905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.776767+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.776767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:30.408058+0000","scrub_duration":0.0019839609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.997169+0000","last_change":"2023-10-14T11:24:24.997231+0000","last_active":"2023-10-14T11:24:24.997169+0000","last_peered":"2023-10-14T11:24:24.997169+0000","last_clean":"2023-10-14T11:24:24.997169+0000","last_became_active":"2023-10-14T11:23:53.849708+0000","last_became_peered":"2023-10-14T11:23:53.849708+0000","last_unstale":"2023-10-14T11:24:24.997169+0000","last_undegraded":"2023-10-14T11:24:24.997169+0000","last_fullsized":"2023-10-14T11:24:24.997169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.997051+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.997051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:25.943950+0000","scrub_duration":0.0018370400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.658392+0000","last_change":"2023-10-14T11:24:16.658443+0000","last_active":"2023-10-14T11:24:16.658392+0000","last_peered":"2023-10-14T11:24:16.658392+0000","last_clean":"2023-10-14T11:24:16.658392+0000","last_became_active":"2023-10-14T11:23:54.860905+0000","last_became_peered":"2023-10-14T11:23:54.860905+0000","last_unstale":"2023-10-14T11:24:16.658392+0000","last_undegraded":"2023-10-14T11:24:16.658392+0000","last_fullsized":"2023-10-14T11:24:16.658392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.658265+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.658265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:59:09.623097+0000","scrub_duration":0.002318826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:06.515192+0000","last_change":"2023-10-14T11:24:06.515272+0000","last_active":"2023-10-14T11:24:06.515192+0000","last_peered":"2023-10-14T11:24:06.515192+0000","last_clean":"2023-10-14T11:24:06.515192+0000","last_became_active":"2023-10-14T11:23:53.842886+0000","last_became_peered":"2023-10-14T11:23:53.842886+0000","last_unstale":"2023-10-14T11:24:06.515192+0000","last_undegraded":"2023-10-14T11:24:06.515192+0000","last_fullsized":"2023-10-14T11:24:06.515192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:06.515039+0000","last_clean_scrub_stamp":"2023-10-14T11:24:06.515039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:02:17.317480+0000","scrub_duration":0.001648042,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.679270+0000","last_change":"2023-10-14T11:24:20.679372+0000","last_active":"2023-10-14T11:24:20.679270+0000","last_peered":"2023-10-14T11:24:20.679270+0000","last_clean":"2023-10-14T11:24:20.679270+0000","last_became_active":"2023-10-14T11:23:54.861579+0000","last_became_peered":"2023-10-14T11:23:54.861579+0000","last_unstale":"2023-10-14T11:24:20.679270+0000","last_undegraded":"2023-10-14T11:24:20.679270+0000","last_fullsized":"2023-10-14T11:24:20.679270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.679137+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.679137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:25.181756+0000","scrub_duration":0.0016657740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.623905+0000","last_change":"2023-10-14T11:24:16.623954+0000","last_active":"2023-10-14T11:24:16.623905+0000","last_peered":"2023-10-14T11:24:16.623905+0000","last_clean":"2023-10-14T11:24:16.623905+0000","last_became_active":"2023-10-14T11:23:53.840928+0000","last_became_peered":"2023-10-14T11:23:53.840928+0000","last_unstale":"2023-10-14T11:24:16.623905+0000","last_undegraded":"2023-10-14T11:24:16.623905+0000","last_fullsized":"2023-10-14T11:24:16.623905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.623790+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.623790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:51:10.423515+0000","scrub_duration":0.0020869059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.646219+0000","last_change":"2023-10-14T11:24:11.646268+0000","last_active":"2023-10-14T11:24:11.646219+0000","last_peered":"2023-10-14T11:24:11.646219+0000","last_clean":"2023-10-14T11:24:11.646219+0000","last_became_active":"2023-10-14T11:23:54.860726+0000","last_became_peered":"2023-10-14T11:23:54.860726+0000","last_unstale":"2023-10-14T11:24:11.646219+0000","last_undegraded":"2023-10-14T11:24:11.646219+0000","last_fullsized":"2023-10-14T11:24:11.646219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:11.646099+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.646099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:38:23.978037+0000","scrub_duration":0.001698242,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:17.988120+0000","last_change":"2023-10-14T11:24:17.988172+0000","last_active":"2023-10-14T11:24:17.988120+0000","last_peered":"2023-10-14T11:24:17.988120+0000","last_clean":"2023-10-14T11:24:17.988120+0000","last_became_active":"2023-10-14T11:23:53.842788+0000","last_became_peered":"2023-10-14T11:23:53.842788+0000","last_unstale":"2023-10-14T11:24:17.988120+0000","last_undegraded":"2023-10-14T11:24:17.988120+0000","last_fullsized":"2023-10-14T11:24:17.988120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:17.988015+0000","last_clean_scrub_stamp":"2023-10-14T11:24:17.988015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:56:59.465375+0000","scrub_duration":0.0020367390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:56.222306+0000","last_change":"2023-10-14T11:24:56.222376+0000","last_active":"2023-10-14T11:24:56.222306+0000","last_peered":"2023-10-14T11:24:56.222306+0000","last_clean":"2023-10-14T11:24:56.222306+0000","last_became_active":"2023-10-14T11:23:54.859490+0000","last_became_peered":"2023-10-14T11:23:54.859490+0000","last_unstale":"2023-10-14T11:24:56.222306+0000","last_undegraded":"2023-10-14T11:24:56.222306+0000","last_fullsized":"2023-10-14T11:24:56.222306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:56.222178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:56.222178+0000","last_clean_scrub_stamp":"2023-10-14T11:24:56.222178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:31:52.926007+0000","scrub_duration":0.0017016449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:24.626811+0000","last_change":"2023-10-14T11:24:24.626862+0000","last_active":"2023-10-14T11:24:24.626811+0000","last_peered":"2023-10-14T11:24:24.626811+0000","last_clean":"2023-10-14T11:24:24.626811+0000","last_became_active":"2023-10-14T11:23:53.850723+0000","last_became_peered":"2023-10-14T11:23:53.850723+0000","last_unstale":"2023-10-14T11:24:24.626811+0000","last_undegraded":"2023-10-14T11:24:24.626811+0000","last_fullsized":"2023-10-14T11:24:24.626811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:24.626702+0000","last_clean_scrub_stamp":"2023-10-14T11:24:24.626702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:00:08.286879+0000","scrub_duration":0.001499691,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:34.826017+0000","last_change":"2023-10-14T11:24:34.826073+0000","last_active":"2023-10-14T11:24:34.826017+0000","last_peered":"2023-10-14T11:24:34.826017+0000","last_clean":"2023-10-14T11:24:34.826017+0000","last_became_active":"2023-10-14T11:23:54.864173+0000","last_became_peered":"2023-10-14T11:23:54.864173+0000","last_unstale":"2023-10-14T11:24:34.826017+0000","last_undegraded":"2023-10-14T11:24:34.826017+0000","last_fullsized":"2023-10-14T11:24:34.826017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:34.825890+0000","last_clean_scrub_stamp":"2023-10-14T11:24:34.825890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:37.040029+0000","scrub_duration":0.001947362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:12.137672+0000","last_change":"2023-10-14T11:24:12.137759+0000","last_active":"2023-10-14T11:24:12.137672+0000","last_peered":"2023-10-14T11:24:12.137672+0000","last_clean":"2023-10-14T11:24:12.137672+0000","last_became_active":"2023-10-14T11:23:53.841758+0000","last_became_peered":"2023-10-14T11:23:53.841758+0000","last_unstale":"2023-10-14T11:24:12.137672+0000","last_undegraded":"2023-10-14T11:24:12.137672+0000","last_fullsized":"2023-10-14T11:24:12.137672+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-10-14T11:24:12.137511+0000","last_clean_scrub_stamp":"2023-10-14T11:24:12.137511+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:19.569117+0000","scrub_duration":0.0022568279999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:25:17.617674+0000","last_change":"2023-10-14T11:25:17.617772+0000","last_active":"2023-10-14T11:25:17.617674+0000","last_peered":"2023-10-14T11:25:17.617674+0000","last_clean":"2023-10-14T11:25:17.617674+0000","last_became_active":"2023-10-14T11:23:54.869954+0000","last_became_peered":"2023-10-14T11:23:54.869954+0000","last_unstale":"2023-10-14T11:25:17.617674+0000","last_undegraded":"2023-10-14T11:25:17.617674+0000","last_fullsized":"2023-10-14T11:25:17.617674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:25:17.617555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:25:17.617555+0000","last_clean_scrub_stamp":"2023-10-14T11:25:17.617555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:59:49.324910+0000","scrub_duration":0.0020815289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:13.379212+0000","last_change":"2023-10-14T11:24:13.379271+0000","last_active":"2023-10-14T11:24:13.379212+0000","last_peered":"2023-10-14T11:24:13.379212+0000","last_clean":"2023-10-14T11:24:13.379212+0000","last_became_active":"2023-10-14T11:23:53.844016+0000","last_became_peered":"2023-10-14T11:23:53.844016+0000","last_unstale":"2023-10-14T11:24:13.379212+0000","last_undegraded":"2023-10-14T11:24:13.379212+0000","last_fullsized":"2023-10-14T11:24:13.379212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1","last_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_deep_scrub":"32'1","last_deep_scrub_stamp":"2023-10-14T11:24:13.379092+0000","last_clean_scrub_stamp":"2023-10-14T11:24:13.379092+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:35:17.881711+0000","scrub_duration":0.00205668,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:18.349746+0000","last_change":"2023-10-14T11:24:18.349802+0000","last_active":"2023-10-14T11:24:18.349746+0000","last_peered":"2023-10-14T11:24:18.349746+0000","last_clean":"2023-10-14T11:24:18.349746+0000","last_became_active":"2023-10-14T11:23:54.870743+0000","last_became_peered":"2023-10-14T11:23:54.870743+0000","last_unstale":"2023-10-14T11:24:18.349746+0000","last_undegraded":"2023-10-14T11:24:18.349746+0000","last_fullsized":"2023-10-14T11:24:18.349746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:18.349596+0000","last_clean_scrub_stamp":"2023-10-14T11:24:18.349596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:41:15.980887+0000","scrub_duration":0.0016496950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:16.201195+0000","last_change":"2023-10-14T11:24:16.201259+0000","last_active":"2023-10-14T11:24:16.201195+0000","last_peered":"2023-10-14T11:24:16.201195+0000","last_clean":"2023-10-14T11:24:16.201195+0000","last_became_active":"2023-10-14T11:23:53.850433+0000","last_became_peered":"2023-10-14T11:23:53.850433+0000","last_unstale":"2023-10-14T11:24:16.201195+0000","last_undegraded":"2023-10-14T11:24:16.201195+0000","last_fullsized":"2023-10-14T11:24:16.201195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:16.201090+0000","last_clean_scrub_stamp":"2023-10-14T11:24:16.201090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:24.787692+0000","scrub_duration":0.0016295120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:25.661091+0000","last_change":"2023-10-14T11:24:25.661135+0000","last_active":"2023-10-14T11:24:25.661091+0000","last_peered":"2023-10-14T11:24:25.661091+0000","last_clean":"2023-10-14T11:24:25.661091+0000","last_became_active":"2023-10-14T11:23:54.860167+0000","last_became_peered":"2023-10-14T11:23:54.860167+0000","last_unstale":"2023-10-14T11:24:25.661091+0000","last_undegraded":"2023-10-14T11:24:25.661091+0000","last_fullsized":"2023-10-14T11:24:25.661091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:25.660987+0000","last_clean_scrub_stamp":"2023-10-14T11:24:25.660987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:27.875126+0000","scrub_duration":0.0019431870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.446770+0000","last_change":"2023-10-14T11:24:10.446815+0000","last_active":"2023-10-14T11:24:10.446770+0000","last_peered":"2023-10-14T11:24:10.446770+0000","last_clean":"2023-10-14T11:24:10.446770+0000","last_became_active":"2023-10-14T11:23:53.844089+0000","last_became_peered":"2023-10-14T11:23:53.844089+0000","last_unstale":"2023-10-14T11:24:10.446770+0000","last_undegraded":"2023-10-14T11:24:10.446770+0000","last_fullsized":"2023-10-14T11:24:10.446770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.446679+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.446679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:06:49.333800+0000","scrub_duration":0.0018293230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:20.387752+0000","last_change":"2023-10-14T11:24:20.387801+0000","last_active":"2023-10-14T11:24:20.387752+0000","last_peered":"2023-10-14T11:24:20.387752+0000","last_clean":"2023-10-14T11:24:20.387752+0000","last_became_active":"2023-10-14T11:23:54.857659+0000","last_became_peered":"2023-10-14T11:23:54.857659+0000","last_unstale":"2023-10-14T11:24:20.387752+0000","last_undegraded":"2023-10-14T11:24:20.387752+0000","last_fullsized":"2023-10-14T11:24:20.387752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:20.387627+0000","last_clean_scrub_stamp":"2023-10-14T11:24:20.387627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:52:28.974229+0000","scrub_duration":0.001943073,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:08.171269+0000","last_change":"2023-10-14T11:24:08.171308+0000","last_active":"2023-10-14T11:24:08.171269+0000","last_peered":"2023-10-14T11:24:08.171269+0000","last_clean":"2023-10-14T11:24:08.171269+0000","last_became_active":"2023-10-14T11:23:53.839078+0000","last_became_peered":"2023-10-14T11:23:53.839078+0000","last_unstale":"2023-10-14T11:24:08.171269+0000","last_undegraded":"2023-10-14T11:24:08.171269+0000","last_fullsized":"2023-10-14T11:24:08.171269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:08.171180+0000","last_clean_scrub_stamp":"2023-10-14T11:24:08.171180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:17.481955+0000","scrub_duration":0.0018328719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:32.123711+0000","last_change":"2023-10-14T11:24:32.123785+0000","last_active":"2023-10-14T11:24:32.123711+0000","last_peered":"2023-10-14T11:24:32.123711+0000","last_clean":"2023-10-14T11:24:32.123711+0000","last_became_active":"2023-10-14T11:23:54.846709+0000","last_became_peered":"2023-10-14T11:23:54.846709+0000","last_unstale":"2023-10-14T11:24:32.123711+0000","last_undegraded":"2023-10-14T11:24:32.123711+0000","last_fullsized":"2023-10-14T11:24:32.123711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:32.123562+0000","last_clean_scrub_stamp":"2023-10-14T11:24:32.123562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:58:19.665259+0000","scrub_duration":0.0016330889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:15.978070+0000","last_change":"2023-10-14T11:24:15.978119+0000","last_active":"2023-10-14T11:24:15.978070+0000","last_peered":"2023-10-14T11:24:15.978070+0000","last_clean":"2023-10-14T11:24:15.978070+0000","last_became_active":"2023-10-14T11:23:53.839905+0000","last_became_peered":"2023-10-14T11:23:53.839905+0000","last_unstale":"2023-10-14T11:24:15.978070+0000","last_undegraded":"2023-10-14T11:24:15.978070+0000","last_fullsized":"2023-10-14T11:24:15.978070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:15.977938+0000","last_clean_scrub_stamp":"2023-10-14T11:24:15.977938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:09:18.192077+0000","scrub_duration":0.0017069959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:39.082766+0000","last_change":"2023-10-14T11:24:39.082831+0000","last_active":"2023-10-14T11:24:39.082766+0000","last_peered":"2023-10-14T11:24:39.082766+0000","last_clean":"2023-10-14T11:24:39.082766+0000","last_became_active":"2023-10-14T11:23:54.858038+0000","last_became_peered":"2023-10-14T11:23:54.858038+0000","last_unstale":"2023-10-14T11:24:39.082766+0000","last_undegraded":"2023-10-14T11:24:39.082766+0000","last_fullsized":"2023-10-14T11:24:39.082766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:39.082622+0000","last_clean_scrub_stamp":"2023-10-14T11:24:39.082622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:52:58.935204+0000","scrub_duration":0.002294815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.980966+0000","last_change":"2023-10-14T11:24:10.981021+0000","last_active":"2023-10-14T11:24:10.980966+0000","last_peered":"2023-10-14T11:24:10.980966+0000","last_clean":"2023-10-14T11:24:10.980966+0000","last_became_active":"2023-10-14T11:23:53.845974+0000","last_became_peered":"2023-10-14T11:23:53.845974+0000","last_unstale":"2023-10-14T11:24:10.980966+0000","last_undegraded":"2023-10-14T11:24:10.980966+0000","last_fullsized":"2023-10-14T11:24:10.980966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.980842+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.980842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:59:54.641019+0000","scrub_duration":0.0019702180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:53.228137+0000","last_change":"2023-10-14T11:24:53.228189+0000","last_active":"2023-10-14T11:24:53.228137+0000","last_peered":"2023-10-14T11:24:53.228137+0000","last_clean":"2023-10-14T11:24:53.228137+0000","last_became_active":"2023-10-14T11:23:54.863004+0000","last_became_peered":"2023-10-14T11:23:54.863004+0000","last_unstale":"2023-10-14T11:24:53.228137+0000","last_undegraded":"2023-10-14T11:24:53.228137+0000","last_fullsized":"2023-10-14T11:24:53.228137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:53.228008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:53.228008+0000","last_clean_scrub_stamp":"2023-10-14T11:24:53.228008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:13.080591+0000","scrub_duration":0.00196137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:10.561706+0000","last_change":"2023-10-14T11:24:10.561759+0000","last_active":"2023-10-14T11:24:10.561706+0000","last_peered":"2023-10-14T11:24:10.561706+0000","last_clean":"2023-10-14T11:24:10.561706+0000","last_became_active":"2023-10-14T11:23:53.836943+0000","last_became_peered":"2023-10-14T11:23:53.836943+0000","last_unstale":"2023-10-14T11:24:10.561706+0000","last_undegraded":"2023-10-14T11:24:10.561706+0000","last_fullsized":"2023-10-14T11:24:10.561706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T11:24:10.561597+0000","last_clean_scrub_stamp":"2023-10-14T11:24:10.561597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:48:55.360382+0000","scrub_duration":0.0015897629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":186,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-14T11:24:11.419316+0000","last_change":"2023-10-14T11:24:11.419316+0000","last_active":"2023-10-14T11:24:11.419316+0000","last_peered":"2023-10-14T11:24:11.419316+0000","last_clean":"2023-10-14T11:24:11.419316+0000","last_became_active":"2023-10-14T11:22:54.527074+0000","last_became_peered":"2023-10-14T11:22:54.527074+0000","last_unstale":"2023-10-14T11:24:11.419316+0000","last_undegraded":"2023-10-14T11:24:11.419316+0000","last_fullsized":"2023-10-14T11:24:11.419316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2023-10-14T11:24:11.419125+0000","last_clean_scrub_stamp":"2023-10-14T11:24:11.419125+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:28:27.365475+0000","scrub_duration":0.0059804070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":729299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73199999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.53400000000000003}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66000000000000003,"5min":1.089,"15min":1.089},"last":0.439},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.443,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.69999999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58699999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.69899999999999995,"15min":0.71299999999999997},"min":{"1min":0.47999999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.77700000000000002,"5min":1.641,"15min":1.641},"last":0.64900000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54100000000000004,"15min":0.55100000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76100000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71299999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":5,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58699999999999997,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69099999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.622},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65100000000000002,"15min":0.65800000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.80700000000000005,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.498},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60199999999999998,"15min":0.60599999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.75600000000000001,"5min":0.879,"15min":0.879},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54200000000000004,"15min":0.53300000000000003},"min":{"1min":0.47199999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.71999999999999997}]},{"osd":1,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55200000000000005,"15min":0.54400000000000004},"min":{"1min":0.44500000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.47599999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.74299999999999999}]},{"osd":2,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.70999999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.745,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56599999999999995}]},{"osd":3,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.54200000000000004}]},{"osd":4,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.38400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.63800000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66400000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.371}]},{"osd":5,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63500000000000001,"5min":1.01,"15min":1.01},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.66200000000000003,"15min":0.67900000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48399999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:24:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.72299999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63600000000000001,"15min":0.64400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.69699999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.44500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.56899999999999995,"15min":0.60199999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.58899999999999997,"5min":4.923,"15min":4.923},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.621,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.628,"5min":4.9809999999999999,"15min":4.9809999999999999},"last":0.58199999999999996}]},{"osd":2,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.443,"5min":0.65500000000000003,"15min":0.68999999999999995},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":5.3209999999999997,"15min":5.3209999999999997},"last":0.42299999999999999}]},{"osd":3,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.64300000000000002,"15min":0.67500000000000004},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.61799999999999999,"15min":0.64800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57599999999999996,"5min":5.0250000000000004,"15min":5.0250000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.83599999999999997,"15min":0.875},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.81899999999999995,"5min":5.7270000000000003,"15min":5.7270000000000003},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":0.88400000000000001},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.93200000000000005,"5min":5.4569999999999999,"15min":5.4569999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.89500000000000002,"15min":0.93799999999999994},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":5.665,"15min":5.665},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.86699999999999999,"15min":0.90300000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.88900000000000001,"5min":5.4349999999999996,"15min":5.4349999999999996},"last":0.63600000000000001}]},{"osd":6,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.86299999999999999,"15min":0.89900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89100000000000001,"5min":5.6399999999999997,"15min":5.6399999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.872,"15min":0.91000000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88700000000000001,"5min":5.548,"15min":5.548},"last":0.747}]},{"osd":7,"last update":"Sat Oct 14 11:24:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.89500000000000002,"15min":0.93400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86099999999999999,"5min":5.5830000000000002,"15min":5.5830000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.86599999999999999,"15min":0.89800000000000002},"min":{"1min":0.44500000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91000000000000003,"5min":5.6929999999999996,"15min":5.6929999999999996},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":729209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35199999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.58899999999999997,"15min":0.62},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.70099999999999996,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.32000000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.626,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.64800000000000002,"15min":0.68200000000000005},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65000000000000002,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.44500000000000001}]},{"osd":3,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38800000000000001},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.55000000000000004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.503},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.81899999999999995,"15min":0.85099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93700000000000006,"5min":4.952,"15min":4.952},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.47199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.012,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.83399999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.86899999999999999,"15min":0.90100000000000002},"min":{"1min":0.47199999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.002,"5min":5.0510000000000002,"15min":5.0510000000000002},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.47499999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.98299999999999998,"5min":1.25,"15min":1.25},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88900000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76100000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.88700000000000001,"15min":0.91900000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97599999999999998,"5min":5.1219999999999999,"15min":5.1219999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.93300000000000005,"5min":1.296,"15min":1.296},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":138911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.42699999999999999,"15min":0.432},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.58599999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.30599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":0.55400000000000005,"5min":0.874,"15min":0.874},"last":0.36399999999999999}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.309,"5min":0.222,"15min":0.222},"max":{"1min":0.63,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66700000000000004,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42299999999999999,"15min":0.42099999999999999},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63200000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.69499999999999995,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.46800000000000003}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.496,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91800000000000004,"5min":1.944,"15min":1.944},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80600000000000005,"5min":1.72,"15min":1.72},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94399999999999995,"5min":1.909,"15min":1.909},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.46000000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66900000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":1.782,"15min":1.782},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.48299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86599999999999999,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88200000000000001,"5min":1.673,"15min":1.673},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":140475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.35299999999999998},"min":{"1min":0.247,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.505,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.38},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38,"15min":0.373},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.31}]},{"osd":1,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.25900000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.52400000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.318,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.51200000000000001}]},{"osd":2,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.40200000000000002,"15min":0.39400000000000002},"min":{"1min":0.32300000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44400000000000001},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63200000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55300000000000005}]},{"osd":4,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.54400000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":1.002,"15min":1.002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.61099999999999999},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.94599999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.49199999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.98799999999999999,"5min":1.093,"15min":1.093},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.65300000000000002,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.87,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.60099999999999998}]},{"osd":6,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63400000000000001,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85599999999999998,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.55200000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89500000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72699999999999998,"5min":1.431,"15min":1.431},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.68799999999999994,"15min":0.70099999999999996},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.78800000000000003,"5min":4.2380000000000004,"15min":4.2380000000000004},"last":0.626}]},{"osd":1,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.48599999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83799999999999997,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.49399999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.82699999999999996,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.76200000000000001,"15min":0.79200000000000004},"min":{"1min":0.46600000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":5.625,"15min":5.625},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.86399999999999999,"15min":0.90600000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":0.59199999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.69299999999999995,"15min":0.70699999999999996},"min":{"1min":0.46800000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.755,"15min":0.77900000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85699999999999998,"5min":3.9820000000000002,"15min":3.9820000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.57099999999999995,"15min":0.59099999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63300000000000001,"5min":1.488,"15min":1.488},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.55000000000000004}]},{"osd":6,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56499999999999995,"15min":0.57299999999999995},"min":{"1min":0.33400000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75800000000000001,"5min":1.004,"15min":1.004},"last":0.502},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.38900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72699999999999998,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57899999999999996,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.73899999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68200000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47099999999999997,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.755},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.374,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65100000000000002}]},{"osd":2,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.47699999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76900000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.621},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82299999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.72999999999999998}]},{"osd":4,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.57399999999999995,"15min":0.58599999999999997},"min":{"1min":0.39200000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.70499999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.438},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.374,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69699999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46800000000000003}]},{"osd":6,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.67000000000000004},"min":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81299999999999994,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Sat Oct 14 11:24:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.74199999999999999,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76500000000000001,"5min":1.089,"15min":1.089},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T11:25:31.709 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T11:25:31.865 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.862+0000 7f8227fb7700 1 Processor -- start 2023-10-14T11:25:31.866 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.862+0000 7f8227fb7700 1 -- start start 2023-10-14T11:25:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8227fb7700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f822015aa60 0x7f82200ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.868 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8227fb7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f822015ae40 0x7f82200cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8227fb7700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200ad3c0 con 0x7f82200ccf00 2023-10-14T11:25:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8227fb7700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200d1300 con 0x7f822015aa60 2023-10-14T11:25:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8227fb7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200cd3b0 con 0x7f822015ae40 2023-10-14T11:25:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8225d53700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f822015aa60 0x7f82200ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8225d53700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f822015aa60 0x7f82200ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43648/0 (socket says 172.21.15.67:43648) 2023-10-14T11:25:31.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.863+0000 7f8225d53700 1 -- 172.21.15.67:0/513756154 learned_addr learned my addr 172.21.15.67:0/513756154 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:31.870 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225552700 1 --2- 172.21.15.67:0/513756154 >> v2:172.21.15.72:3300/0 conn(0x7f822015ae40 0x7f82200cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225d53700 1 -- 172.21.15.67:0/513756154 >> v2:172.21.15.72:3300/0 conn(0x7f822015ae40 msgr2=0x7f82200cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:25:31.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225d53700 1 --2- 172.21.15.67:0/513756154 >> v2:172.21.15.72:3300/0 conn(0x7f822015ae40 0x7f82200cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.871 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225d53700 1 -- 172.21.15.67:0/513756154 >> v1:172.21.15.72:6789/0 conn(0x7f82200ccf00 legacy=0x7f82200ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225d53700 1 -- 172.21.15.67:0/513756154 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200ce8f0 con 0x7f822015aa60 2023-10-14T11:25:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8225d53700 1 --2- 172.21.15.67:0/513756154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015aa60 0x7f82200ce3b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8220072e50 tx=0x7f8210009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8873bd9eac1c34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8224d51700 1 -- 172.21.15.67:0/513756154 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210011830 con 0x7f822015aa60 2023-10-14T11:25:31.872 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8224d51700 1 -- 172.21.15.67:0/513756154 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210011990 con 0x7f822015aa60 2023-10-14T11:25:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.864+0000 7f8224d51700 1 -- 172.21.15.67:0/513756154 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210011d20 con 0x7f822015aa60 2023-10-14T11:25:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 -- 172.21.15.67:0/513756154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015aa60 msgr2=0x7f82200ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.873 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 --2- 172.21.15.67:0/513756154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015aa60 0x7f82200ce3b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8220072e50 tx=0x7f8210009bd0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 -- 172.21.15.67:0/513756154 shutdown_connections 2023-10-14T11:25:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 --2- 172.21.15.67:0/513756154 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015aa60 0x7f82200ce3b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 --2- 172.21.15.67:0/513756154 >> v2:172.21.15.72:3300/0 conn(0x7f822015ae40 0x7f82200cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.874 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 -- 172.21.15.67:0/513756154 >> 172.21.15.67:0/513756154 conn(0x7f82200d04b0 msgr2=0x7f82200d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 -- 172.21.15.67:0/513756154 shutdown_connections 2023-10-14T11:25:31.875 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.865+0000 7f8227fb7700 1 -- 172.21.15.67:0/513756154 wait complete. 2023-10-14T11:25:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.866+0000 7f8227fb7700 1 Processor -- start 2023-10-14T11:25:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.866+0000 7f8227fb7700 1 -- start start 2023-10-14T11:25:31.878 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82200ccf00 0x7f82200c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f822015aa60 0x7f8220140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201410f0 con 0x7f822015ae40 2023-10-14T11:25:31.879 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201590f0 con 0x7f82200ccf00 2023-10-14T11:25:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8227fb7700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82201593d0 con 0x7f822015aa60 2023-10-14T11:25:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.880 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43658/0 (socket says 172.21.15.67:43658) 2023-10-14T11:25:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 -- 172.21.15.67:0/3113812468 learned_addr learned my addr 172.21.15.67:0/3113812468 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8225552700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f822015aa60 0x7f8220140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8225d53700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82200ccf00 0x7f82200c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.881 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 -- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f822015aa60 msgr2=0x7f8220140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f822015aa60 0x7f8220140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 -- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82200ccf00 msgr2=0x7f82200c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82200ccf00 0x7f82200c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 -- 172.21.15.67:0/3113812468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210009550 con 0x7f822015ae40 2023-10-14T11:25:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f8226554700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f821800cc50 tx=0x7f821800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218003c00 con 0x7f822015ae40 2023-10-14T11:25:31.883 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.867+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218003d60 con 0x7f822015ae40 2023-10-14T11:25:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.868+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82201596b0 con 0x7f822015ae40 2023-10-14T11:25:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.868+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800aab0 con 0x7f822015ae40 2023-10-14T11:25:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.868+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822013e550 con 0x7f822015ae40 2023-10-14T11:25:31.884 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.868+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82200d0df0 con 0x7f822015ae40 2023-10-14T11:25:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.869+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f821800ac10 con 0x7f822015ae40 2023-10-14T11:25:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.869+0000 7f82167fc700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 0x7f820406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:31.885 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.870+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f8218089540 con 0x7f822015ae40 2023-10-14T11:25:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.870+0000 7f8225d53700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 0x7f820406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.870+0000 7f8225d53700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 0x7f820406d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8210000c00 tx=0x7f8210008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:31.886 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:31.874+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8218054660 con 0x7f822015ae40 2023-10-14T11:25:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.075+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f822004ebb0 con 0x7f822015ae40 2023-10-14T11:25:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.078+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8218057c80 con 0x7f822015ae40 2023-10-14T11:25:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.078+0000 7f82167fc700 1 -- 172.21.15.67:0/3113812468 <== mon.0 v2:172.21.15.67:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8218001cd0 con 0x7f822015ae40 2023-10-14T11:25:32.084 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 msgr2=0x7f820406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 0x7f820406d3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8210000c00 tx=0x7f8210008030 comp rx=0 tx=0).stop 2023-10-14T11:25:32.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 msgr2=0x7f8220140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.085 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f821800cc50 tx=0x7f821800cf60 comp rx=0 tx=0).stop 2023-10-14T11:25:32.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 shutdown_connections 2023-10-14T11:25:32.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f820406af00 0x7f820406d3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f822015ae40 0x7f8220140840 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.086 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82200ccf00 0x7f82200c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 --2- 172.21.15.67:0/3113812468 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f822015aa60 0x7f8220140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 >> 172.21.15.67:0/3113812468 conn(0x7f82200d04b0 msgr2=0x7f8220153de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:32.087 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 shutdown_connections 2023-10-14T11:25:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.080+0000 7f8227fb7700 1 -- 172.21.15.67:0/3113812468 wait complete. 2023-10-14T11:25:32.095 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T11:25:32.096 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T11:25:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.217+0000 7f3b8471d700 1 Processor -- start 2023-10-14T11:25:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.217+0000 7f3b8471d700 1 -- start start 2023-10-14T11:25:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b7c15b980 0x7f3b7c072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b7c06a810 0x7f3b7c06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c0cc260 0x7f3b7c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 -- --> v2:172.21.15.67:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c15bd60 con 0x7f3b7c06a810 2023-10-14T11:25:32.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c072b70 con 0x7f3b7c15b980 2023-10-14T11:25:32.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b8471d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c071be0 con 0x7f3b7c0cc260 2023-10-14T11:25:32.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.218+0000 7f3b81cb8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b7c06a810 0x7f3b7c06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.225 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 --2- >> v2:172.21.15.67:3300/0 conn(0x7f3b7c06a810 0x7f3b7c06aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43662/0 (socket says 172.21.15.67:43662) 2023-10-14T11:25:32.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 -- 172.21.15.67:0/187627795 learned_addr learned my addr 172.21.15.67:0/187627795 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:32.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b824b9700 1 --2- 172.21.15.67:0/187627795 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c15b980 0x7f3b7c072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.226 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b82cba700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c0cc260 0x7f3b7c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 -- 172.21.15.67:0/187627795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c0cc260 msgr2=0x7f3b7c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:25:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c0cc260 0x7f3b7c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 -- 172.21.15.67:0/187627795 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c15b980 msgr2=0x7f3b7c072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T11:25:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/187627795 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c15b980 0x7f3b7c072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 -- 172.21.15.67:0/187627795 --> v2:172.21.15.67:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0ccbd0 con 0x7f3b7c06a810 2023-10-14T11:25:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c06a810 0x7f3b7c06aca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c067690 tx=0x7f3b6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f413509e721bb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b814b7700 1 -- 172.21.15.67:0/187627795 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011830 con 0x7f3b7c06a810 2023-10-14T11:25:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b814b7700 1 -- 172.21.15.67:0/187627795 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3b6c011990 con 0x7f3b7c06a810 2023-10-14T11:25:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.219+0000 7f3b814b7700 1 -- 172.21.15.67:0/187627795 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011d40 con 0x7f3b7c06a810 2023-10-14T11:25:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 -- 172.21.15.67:0/187627795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c06a810 msgr2=0x7f3b7c06aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.229 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c06a810 0x7f3b7c06aca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c067690 tx=0x7f3b6c009bd0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 -- 172.21.15.67:0/187627795 shutdown_connections 2023-10-14T11:25:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c0cc260 0x7f3b7c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 --2- 172.21.15.67:0/187627795 >> v2:172.21.15.72:3300/0 conn(0x7f3b7c15b980 0x7f3b7c072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 --2- 172.21.15.67:0/187627795 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c06a810 0x7f3b7c06aca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 -- 172.21.15.67:0/187627795 >> 172.21.15.67:0/187627795 conn(0x7f3b7c0d0440 msgr2=0x7f3b7c0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 -- 172.21.15.67:0/187627795 shutdown_connections 2023-10-14T11:25:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.220+0000 7f3b8471d700 1 -- 172.21.15.67:0/187627795 wait complete. 2023-10-14T11:25:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.221+0000 7f3b8471d700 1 Processor -- start 2023-10-14T11:25:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.221+0000 7f3b8471d700 1 -- start start 2023-10-14T11:25:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 --2- >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 0x7f3b7c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.235 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 0x7f3b7c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 -- --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c157a10 con 0x7f3b7c0cc260 2023-10-14T11:25:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c156a00 con 0x7f3b7c15b980 2023-10-14T11:25:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b8471d700 1 -- --> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c156c50 con 0x7f3b7c06a810 2023-10-14T11:25:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 --2- >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.67:3300/0 says I am v2:172.21.15.67:43670/0 (socket says 172.21.15.67:43670) 2023-10-14T11:25:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 -- 172.21.15.67:0/1488787589 learned_addr learned my addr 172.21.15.67:0/1488787589 (peer_addr_for_me v2:172.21.15.67:0/0) 2023-10-14T11:25:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b82cba700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 0x7f3b7c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b824b9700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 0x7f3b7c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 -- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 msgr2=0x7f3b7c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 0x7f3b7c153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 -- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 msgr2=0x7f3b7c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 0x7f3b7c0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 -- 172.21.15.67:0/1488787589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009550 con 0x7f3b7c0cc260 2023-10-14T11:25:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b824b9700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 0x7f3b7c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:25:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b82cba700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 0x7f3b7c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T11:25:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.222+0000 7f3b81cb8700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c000c00 tx=0x7f3b6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.223+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c004300 con 0x7f3b7c0cc260 2023-10-14T11:25:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.223+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3b6c01f070 con 0x7f3b7c0cc260 2023-10-14T11:25:32.246 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.223+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c156f30 con 0x7f3b7c0cc260 2023-10-14T11:25:32.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.223+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0036a0 con 0x7f3b7c0cc260 2023-10-14T11:25:32.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.223+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c1574f0 con 0x7f3b7c0cc260 2023-10-14T11:25:32.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.224+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c04ebb0 con 0x7f3b7c0cc260 2023-10-14T11:25:32.247 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.224+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b6c021030 con 0x7f3b7c0cc260 2023-10-14T11:25:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.224+0000 7f3b72ffd700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 0x7f3b6006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T11:25:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.225+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f3b6c08a800 con 0x7f3b7c0cc260 2023-10-14T11:25:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.225+0000 7f3b824b9700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 0x7f3b6006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T11:25:32.248 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.225+0000 7f3b824b9700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 0x7f3b6006d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009b90 tx=0x7f3b78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T11:25:32.249 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.229+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b6c055890 con 0x7f3b7c0cc260 2023-10-14T11:25:32.478 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.475+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 --> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b7c1576b0 con 0x7f3b7c0cc260 2023-10-14T11:25:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.475+0000 7f3b72ffd700 1 -- 172.21.15.67:0/1488787589 <== mon.0 v2:172.21.15.67:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f3b6c015020 con 0x7f3b7c0cc260 2023-10-14T11:25:32.479 INFO:teuthology.orchestra.run.smithi067.stdout: 2023-10-14T11:25:32.479 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1587797003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1587797003},{"type":"v1","addr":"172.21.15.72:6837","nonce":1587797003}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.67:6835/3653699709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6833","nonce":3653699709},{"type":"v1","addr":"172.21.15.67:6835","nonce":3653699709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4948,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/3108239461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3108239461},{"type":"v1","addr":"172.21.15.72:6836","nonce":3108239461}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T11:23:54.252164+0000","modified":"2023-10-14T11:23:57.270421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5073":{"gid":5073,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.67:6834/2432149351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":2432149351},{"type":"v1","addr":"172.21.15.67:6834","nonce":2432149351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T11:25:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 msgr2=0x7f3b6006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.481 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 0x7f3b6006d3c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009b90 tx=0x7f3b78008040 comp rx=0 tx=0).stop 2023-10-14T11:25:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 msgr2=0x7f3b7c0b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T11:25:32.482 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c000c00 tx=0x7f3b6c004750 comp rx=0 tx=0).stop 2023-10-14T11:25:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 shutdown_connections 2023-10-14T11:25:32.483 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b7c15b980 0x7f3b7c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:3301/0,v1:172.21.15.72:6790/0] conn(0x7f3b7c06a810 0x7f3b7c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.484 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.72:6832/3280464453,v1:172.21.15.72:6833/3280464453] conn(0x7f3b6006af00 0x7f3b6006d3c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 --2- 172.21.15.67:0/1488787589 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f3b7c0cc260 0x7f3b7c0b1480 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T11:25:32.485 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.477+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 >> 172.21.15.67:0/1488787589 conn(0x7f3b7c0d0440 msgr2=0x7f3b7c0cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T11:25:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.478+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 shutdown_connections 2023-10-14T11:25:32.486 INFO:teuthology.orchestra.run.smithi067.stderr:2023-10-14T11:25:32.478+0000 7f3b8471d700 1 -- 172.21.15.67:0/1488787589 wait complete. 2023-10-14T11:25:32.487 INFO:teuthology.orchestra.run.smithi067.stderr:dumped fsmap epoch 16 2023-10-14T11:25:32.493 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T11:25:32.493 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T11:25:32.494 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T11:25:32.494 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.503 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T11:25:32.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T11:25:32.504 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.552 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T11:25:32.553 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T11:25:32.553 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.564 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T11:25:32.566 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T11:25:32.566 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.616 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T11:25:32.616 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T11:25:32.617 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T11:25:32.617 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.647 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T11:25:32.648 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T11:25:32.648 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.723 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T11:25:32.724 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T11:25:32.724 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.802 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T11:25:32.803 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T11:25:32.803 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.876 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T11:25:32.876 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T11:25:32.877 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.908 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T11:25:32.909 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T11:25:32.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:32.989 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T11:25:32.990 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T11:25:32.990 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.058 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T11:25:33.058 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T11:25:33.059 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.135 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T11:25:33.136 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T11:25:33.137 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T11:25:33.137 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.159 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T11:25:33.160 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T11:25:33.160 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.204 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T11:25:33.205 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T11:25:33.205 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T11:25:33.206 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.216 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T11:25:33.216 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T11:25:33.216 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.257 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T11:25:33.258 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T11:25:33.258 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T11:25:33.310 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T11:25:33.311 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T11:25:33.312 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-14T11:25:33.344 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:25:33.345 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T11:25:33.559 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:25:33.560 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T11:25:33.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:25:33.664 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T11:25:33.736 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:25:33.737 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T11:25:33.817 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:25:33.818 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T11:25:34.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:25:34.060 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T11:25:34.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:25:34.164 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T11:25:34.207 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:34.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:34.235 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:25:34.236 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T11:25:34.381 INFO:tasks.ceph:Archiving mon data... 2023-10-14T11:25:34.383 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/data/mon.a.tgz 2023-10-14T11:25:34.384 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2023-10-14T11:25:34.402 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.BBbvXdL66y 2023-10-14T11:25:34.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BBbvXdL66y 2023-10-14T11:25:34.533 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.BBbvXdL66y 2023-10-14T11:25:34.623 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.BBbvXdL66y is 288KB 2023-10-14T11:25:34.719 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.BBbvXdL66y 2023-10-14T11:25:34.736 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/data/mon.b.tgz 2023-10-14T11:25:34.736 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-14T11:25:34.754 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.BPa3DvuGVf 2023-10-14T11:25:34.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.BPa3DvuGVf 2023-10-14T11:25:34.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.BPa3DvuGVf 2023-10-14T11:25:34.990 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.BPa3DvuGVf is 387KB 2023-10-14T11:25:35.091 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.BPa3DvuGVf 2023-10-14T11:25:35.108 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/data/mon.c.tgz 2023-10-14T11:25:35.109 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-10-14T11:25:35.163 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.9t2zGEHoev 2023-10-14T11:25:35.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.9t2zGEHoev 2023-10-14T11:25:35.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.9t2zGEHoev 2023-10-14T11:25:35.384 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.9t2zGEHoev is 387KB 2023-10-14T11:25:35.482 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.9t2zGEHoev 2023-10-14T11:25:35.499 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T11:25:35.500 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T11:25:35.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T11:25:35.565 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T11:25:35.565 DEBUG:teuthology.orchestra.run.smithi067:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T11:25:35.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T11:25:35.611 INFO:teuthology.orchestra.run.smithi067.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T11:25:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T11:25:35.643 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T11:25:35.645 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi067/crash 2023-10-14T11:25:35.646 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T11:25:35.691 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi072/crash 2023-10-14T11:25:35.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T11:25:35.719 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T11:25:35.719 DEBUG:teuthology.orchestra.run.smithi067:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:35.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:35.811 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:35.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T11:25:35.867 INFO:tasks.ceph:Compressing logs... 2023-10-14T11:25:35.868 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T11:25:35.883 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T11:25:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117006.log 2023-10-14T11:25:35.944 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T11:25:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T11:25:35.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111249.log 2023-10-14T11:25:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104305.log 2023-10-14T11:25:35.946 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.3.111249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110638.log 2023-10-14T11:25:35.946 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111249.log.gz 2023-10-14T11:25:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104305.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T11:25:35.947 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.1.110638.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.104305.log.gz 2023-10-14T11:25:35.947 INFO:teuthology.orchestra.run.smithi072.stderr: 91.5%gzip -5 -- replaced with /var/log/ceph/ceph.log.gz--verbose 2023-10-14T11:25:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:-- /var/log/ceph/ceph-client.admin.104025.log 2023-10-14T11:25:35.948 INFO:teuthology.orchestra.run.smithi072.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110638.log.gz 2023-10-14T11:25:35.948 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T11:25:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104070.log 2023-10-14T11:25:35.949 INFO:teuthology.orchestra.run.smithi072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104025.log.gz 2023-10-14T11:25:35.949 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T11:25:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T11:25:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104070.log: /var/log/ceph/ceph.audit.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104070.log.gz 2023-10-14T11:25:35.950 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T11:25:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103978.log 2023-10-14T11:25:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T11:25:35.951 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.103978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104162.log 2023-10-14T11:25:35.952 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mgr.x.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103978.log.gz 2023-10-14T11:25:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104162.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104162.log.gz 2023-10-14T11:25:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T11:25:35.954 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104252.log 2023-10-14T11:25:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.104252.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104252.log.gz 2023-10-14T11:25:35.955 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104207.log 2023-10-14T11:25:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104207.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104207.log.gz 2023-10-14T11:25:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104117.log 2023-10-14T11:25:35.956 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.admin.104117.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104117.log.gz 2023-10-14T11:25:35.957 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T11:25:35.959 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110630.log 2023-10-14T11:25:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.1.110630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110630.log.gz 2023-10-14T11:25:35.960 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T11:25:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T11:25:35.981 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T11:25:35.981 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.111245.log 2023-10-14T11:25:35.986 INFO:teuthology.orchestra.run.smithi072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T11:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111291.log 2023-10-14T11:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118160.log 2023-10-14T11:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.116274.log -- replaced with /var/log/ceph/ceph-client.admin.117006.log.gz 2023-10-14T11:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-10-14T11:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111291.log: /var/log/ceph/ceph-client.admin.118160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110244.log 2023-10-14T11:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111291.log.gz 2023-10-14T11:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118160.log.gz 2023-10-14T11:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110840.log 2023-10-14T11:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110244.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116274.log.gz 2023-10-14T11:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111293.log 2023-10-14T11:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110244.log.gz 2023-10-14T11:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116366.log 2023-10-14T11:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111293.log: gzip 89.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.110840.log.gz-- 2023-10-14T11:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114462.log 2023-10-14T11:25:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111293.log.gz 2023-10-14T11:25:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112006.log 2023-10-14T11:25:35.998 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114462.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116366.log.gz 2023-10-14T11:25:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118647.log 2023-10-14T11:25:35.999 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114462.log.gz 2023-10-14T11:25:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111024.log 2023-10-14T11:25:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118647.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112006.log.gz 2023-10-14T11:25:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116868.log 2023-10-14T11:25:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111024.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118647.log.gz 2023-10-14T11:25:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110610.log 2023-10-14T11:25:36.001 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111024.log.gz 2023-10-14T11:25:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119662.log 2023-10-14T11:25:36.001 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.116868.log.gz 2023-10-14T11:25:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110610.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T11:25:36.002 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110610.log.gz 2023-10-14T11:25:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112471.log 2023-10-14T11:25:36.002 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119662.log.gz 2023-10-14T11:25:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112847.log 2023-10-14T11:25:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114784.log 2023-10-14T11:25:36.003 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112471.log.gz 2023-10-14T11:25:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119984.log 2023-10-14T11:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112847.log.gz 2023-10-14T11:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115740.log 2023-10-14T11:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119984.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114784.log.gz 2023-10-14T11:25:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120273.log 2023-10-14T11:25:36.005 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119984.log.gz 2023-10-14T11:25:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119181.log 2023-10-14T11:25:36.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120273.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115740.log.gz 2023-10-14T11:25:36.006 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113583.log 2023-10-14T11:25:36.006 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119181.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120273.log.gz 2023-10-14T11:25:36.007 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118254.log 2023-10-14T11:25:36.007 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.113583.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119181.log.gz 2023-10-14T11:25:36.007 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113583.log.gz 2023-10-14T11:25:36.007 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118885.log 2023-10-14T11:25:36.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116546.log 2023-10-14T11:25:36.008 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.118885.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.118254.log.gz-5 2023-10-14T11:25:36.008 INFO:teuthology.orchestra.run.smithi067.stderr:--verbose -- /var/log/ceph/ceph.log 2023-10-14T11:25:36.008 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118885.log.gz 2023-10-14T11:25:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112709.log 2023-10-14T11:25:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116546.log.gz 2023-10-14T11:25:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110306.log 2023-10-14T11:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119248.log 2023-10-14T11:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110306.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112709.log.gz 2023-10-14T11:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117826.log 2023-10-14T11:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr: 84.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T11:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110306.log.gz 2023-10-14T11:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117328.log 2023-10-14T11:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117826.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119248.log.gz 2023-10-14T11:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113575.log 2023-10-14T11:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117826.log.gz 2023-10-14T11:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117144.log 2023-10-14T11:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.113575.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117328.log.gz 2023-10-14T11:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110368.log 2023-10-14T11:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113575.log.gz 2023-10-14T11:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116592.log 2023-10-14T11:25:36.014 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117144.log.gz 2023-10-14T11:25:36.014 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112425.log 2023-10-14T11:25:36.015 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110368.log.gz 2023-10-14T11:25:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119800.log 2023-10-14T11:25:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112425.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116592.log.gz 2023-10-14T11:25:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111660.log 2023-10-14T11:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112425.log.gz 2023-10-14T11:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112663.log 2023-10-14T11:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.119800.log.gz 2023-10-14T11:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119754.log 2023-10-14T11:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112663.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111660.log.gz 2023-10-14T11:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112241.log 2023-10-14T11:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.112663.log.gz 2023-10-14T11:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111661.log 2023-10-14T11:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112241.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T11:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119754.log.gz 2023-10-14T11:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.112241.log.gz 2023-10-14T11:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118392.log 2023-10-14T11:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111661.log.gz 2023-10-14T11:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:gzip /var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.112939.log 2023-10-14T11:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115061.log 2023-10-14T11:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112939.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118392.log.gz 2023-10-14T11:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119294.log 2023-10-14T11:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115648.log 2023-10-14T11:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115061.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.112939.log.gz 2023-10-14T11:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117190.log 2023-10-14T11:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115061.log.gz 2023-10-14T11:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119294.log.gz 2023-10-14T11:25:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120030.log 2023-10-14T11:25:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111663.log 2023-10-14T11:25:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117190.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115648.log.gz 2023-10-14T11:25:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120030.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117190.log.gz 2023-10-14T11:25:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115383.log 2023-10-14T11:25:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T11:25:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111663.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120030.log.gz 2023-10-14T11:25:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115383.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111663.log.gz 2023-10-14T11:25:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112517.log 2023-10-14T11:25:36.027 INFO:teuthology.orchestra.run.smithi067.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115383.log.gz 2023-10-14T11:25:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118346.log 2023-10-14T11:25:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.112517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119938.log 2023-10-14T11:25:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118346.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.112016.log 2023-10-14T11:25:36.028 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112517.log.gz 2023-10-14T11:25:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119938.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.118346.log.gz 2023-10-14T11:25:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116914.log 2023-10-14T11:25:36.029 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119938.log.gz 2023-10-14T11:25:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111295.log 2023-10-14T11:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116914.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112016.log.gz 2023-10-14T11:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115694.log 2023-10-14T11:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116914.log.gz 2023-10-14T11:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115245.log 2023-10-14T11:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114554.log /var/log/ceph/ceph-client.admin.115694.log: 2023-10-14T11:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111295.log.gz 2023-10-14T11:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115245.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T11:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115694.log.gz 2023-10-14T11:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117918.log 2023-10-14T11:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.115245.log.gz 2023-10-14T11:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117418.log 2023-10-14T11:25:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114554.log: /var/log/ceph/ceph-client.admin.117918.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114554.log.gz 2023-10-14T11:25:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117418.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117918.log.gz 2023-10-14T11:25:36.033 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117418.log.gz 2023-10-14T11:25:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117098.log 2023-10-14T11:25:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110516.log 2023-10-14T11:25:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115966.log 2023-10-14T11:25:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110516.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117098.log.gz 2023-10-14T11:25:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115966.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110516.log.gz 2023-10-14T11:25:36.035 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T11:25:36.035 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115966.log.gz 2023-10-14T11:25:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118208.log 2023-10-14T11:25:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.97629.log 2023-10-14T11:25:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115015.log 2023-10-14T11:25:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.tmp-client.admin.97629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112039.log 2023-10-14T11:25:36.036 INFO:teuthology.orchestra.run.smithi067.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118208.log.gz 2023-10-14T11:25:36.037 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.97629.log.gz 2023-10-14T11:25:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119708.log 2023-10-14T11:25:36.037 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115015.log.gz 2023-10-14T11:25:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112039.log: /var/log/ceph/ceph-client.admin.119708.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112039.log.gz 2023-10-14T11:25:36.038 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119708.log.gz 2023-10-14T11:25:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113093.log 2023-10-14T11:25:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120085.log 2023-10-14T11:25:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.113093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117282.log 2023-10-14T11:25:36.039 INFO:teuthology.orchestra.run.smithi067.stderr: 89.5%/var/log/ceph/ceph-client.admin.120085.log: -- replaced with /var/log/ceph/ceph-client.admin.113093.log.gz 2023-10-14T11:25:36.039 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117282.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120085.log.gz 2023-10-14T11:25:36.039 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117282.log.gz 2023-10-14T11:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119432.log 2023-10-14T11:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110794.log 2023-10-14T11:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119432.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T11:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119432.log.gz 2023-10-14T11:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110422.log 2023-10-14T11:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118114.log 2023-10-14T11:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mds.c.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110794.log.gz 2023-10-14T11:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110422.log: /var/log/ceph/ceph-client.admin.118114.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110422.log.gz 2023-10-14T11:25:36.042 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118114.log.gz 2023-10-14T11:25:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111664.log 2023-10-14T11:25:36.042 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-14T11:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116500.log 2023-10-14T11:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114692.log 2023-10-14T11:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111664.log.gz 2023-10-14T11:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116500.log: 88.0%/var/log/ceph/ceph-client.admin.114692.log: -- replaced with /var/log/ceph/ceph-client.admin.116500.log.gz 2023-10-14T11:25:36.044 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114692.log.gz 2023-10-14T11:25:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112801.log 2023-10-14T11:25:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112893.log 2023-10-14T11:25:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116960.log 2023-10-14T11:25:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118484.log 2023-10-14T11:25:36.045 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.112801.log.gz 2023-10-14T11:25:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116960.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112893.log.gz 2023-10-14T11:25:36.045 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116960.log.gz 2023-10-14T11:25:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118484.log.gz 2023-10-14T11:25:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112287.log 2023-10-14T11:25:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112563.log 2023-10-14T11:25:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110001.log 2023-10-14T11:25:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110932.log 2023-10-14T11:25:36.047 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112287.log.gz 2023-10-14T11:25:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110001.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112563.log.gz 2023-10-14T11:25:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116033.log 2023-10-14T11:25:36.048 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110001.log.gz 2023-10-14T11:25:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114600.log 2023-10-14T11:25:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112011.log 2023-10-14T11:25:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110932.log.gz 2023-10-14T11:25:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114600.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116033.log.gz 2023-10-14T11:25:36.049 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7%/var/log/ceph/ceph-client.admin.112011.log: -- replaced with /var/log/ceph/ceph-client.admin.114600.log.gz 2023-10-14T11:25:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118060.log 2023-10-14T11:25:36.050 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112011.log.gz 2023-10-14T11:25:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110195.log 2023-10-14T11:25:36.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111283.log 2023-10-14T11:25:36.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110195.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118060.log.gz 2023-10-14T11:25:36.051 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111283.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110195.log.gz 2023-10-14T11:25:36.051 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111283.log.gz 2023-10-14T11:25:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111666.log 2023-10-14T11:25:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T11:25:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110468.log 2023-10-14T11:25:36.052 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111666.log.gz 2023-10-14T11:25:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.110468.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110468.log.gz 2023-10-14T11:25:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119846.log 2023-10-14T11:25:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111294.log 2023-10-14T11:25:36.054 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T11:25:36.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115920.log 2023-10-14T11:25:36.054 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117780.log 2023-10-14T11:25:36.054 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119846.log.gz 2023-10-14T11:25:36.055 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115920.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111294.log.gz 2023-10-14T11:25:36.055 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115920.log.gz 2023-10-14T11:25:36.055 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117780.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117780.log.gz 2023-10-14T11:25:36.055 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114508.log 2023-10-14T11:25:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120363.log 2023-10-14T11:25:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115153.log 2023-10-14T11:25:36.056 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.120363.log: -- replaced with /var/log/ceph/ceph-client.admin.114508.log.gz 2023-10-14T11:25:36.057 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119524.log 2023-10-14T11:25:36.057 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115153.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120363.log.gz 2023-10-14T11:25:36.057 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116320.log 2023-10-14T11:25:36.057 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115153.log.gz 2023-10-14T11:25:36.058 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119478.log 2023-10-14T11:25:36.058 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119524.log.gz 2023-10-14T11:25:36.058 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116320.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116320.log.gz 2023-10-14T11:25:36.058 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119478.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119478.log.gz 2023-10-14T11:25:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120227.log 2023-10-14T11:25:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.114240.log 2023-10-14T11:25:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114830.log 2023-10-14T11:25:36.060 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.120227.log.gz 2023-10-14T11:25:36.060 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.114240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.114240.log.gz 2023-10-14T11:25:36.061 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115107.log 2023-10-14T11:25:36.061 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114830.log.gz 2023-10-14T11:25:36.062 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.114236.log 2023-10-14T11:25:36.062 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104359.log 2023-10-14T11:25:36.062 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.2.114236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119386.log 2023-10-14T11:25:36.062 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% 88.3% -- replaced with /var/log/ceph/ceph-client.2.114236.log.gz -- replaced with /var/log/ceph/ceph-client.admin.115107.log.gz 2023-10-14T11:25:36.063 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-10-14T11:25:36.063 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.104359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115291.log 2023-10-14T11:25:36.063 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104359.log.gz 2023-10-14T11:25:36.063 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115521.log 2023-10-14T11:25:36.064 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113805.log 2023-10-14T11:25:36.064 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119386.log.gz 2023-10-14T11:25:36.064 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115521.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115291.log.gz 2023-10-14T11:25:36.065 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115521.log.gz 2023-10-14T11:25:36.065 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.113805.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113805.log.gz 2023-10-14T11:25:36.065 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116822.log 2023-10-14T11:25:36.065 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114877.log 2023-10-14T11:25:36.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111659.log 2023-10-14T11:25:36.066 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114877.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116822.log.gz 2023-10-14T11:25:36.066 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118012.log 2023-10-14T11:25:36.067 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114877.log.gz 2023-10-14T11:25:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114923.log 2023-10-14T11:25:36.067 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111659.log.gz 2023-10-14T11:25:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118012.log: /var/log/ceph/ceph-client.admin.114923.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118012.log.gz 2023-10-14T11:25:36.068 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114923.log.gz 2023-10-14T11:25:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111091.log 2023-10-14T11:25:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110886.log 2023-10-14T11:25:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116228.log 2023-10-14T11:25:36.069 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111091.log.gz 2023-10-14T11:25:36.069 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110886.log: /var/log/ceph/ceph-client.admin.116228.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110886.log.gz 2023-10-14T11:25:36.069 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.116228.log.gz 2023-10-14T11:25:36.070 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115475.log 2023-10-14T11:25:36.070 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117549.log 2023-10-14T11:25:36.070 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 /var/log/ceph/ceph-client.admin.115475.log: --verbose -- /var/log/ceph/ceph-client.admin.118300.log 2023-10-14T11:25:36.070 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119340.log 2023-10-14T11:25:36.071 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115475.log.gz 2023-10-14T11:25:36.071 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118300.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117549.log.gz 2023-10-14T11:25:36.071 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110748.log 2023-10-14T11:25:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119340.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118300.log.gz 2023-10-14T11:25:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T11:25:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110978.log 2023-10-14T11:25:36.072 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119340.log.gz 2023-10-14T11:25:36.073 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110748.log.gz 2023-10-14T11:25:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110564.log 2023-10-14T11:25:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116776.log 2023-10-14T11:25:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110978.log: /var/log/ceph/ceph-client.admin.110564.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110978.log.gz 2023-10-14T11:25:36.074 INFO:teuthology.orchestra.run.smithi067.stderr: 88.5%/var/log/ceph/ceph-client.admin.116776.log: -- replaced with /var/log/ceph/ceph-client.admin.110564.log.gz 2023-10-14T11:25:36.074 INFO:teuthology.orchestra.run.smithi067.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116776.log.gz 2023-10-14T11:25:36.074 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112617.log 2023-10-14T11:25:36.075 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112010.log 2023-10-14T11:25:36.075 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112003.log 2023-10-14T11:25:36.075 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112617.log.gz 2023-10-14T11:25:36.075 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112010.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112010.log.gz 2023-10-14T11:25:36.076 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110702.log 2023-10-14T11:25:36.076 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112003.log: /var/log/ceph/ceph-client.admin.110702.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112003.log.gz 2023-10-14T11:25:36.076 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110702.log.gz 2023-10-14T11:25:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118881.log 2023-10-14T11:25:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115429.log 2023-10-14T11:25:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.118881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116730.log 2023-10-14T11:25:36.077 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118881.log.gz 2023-10-14T11:25:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119892.log 2023-10-14T11:25:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116730.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.115429.log.gz 2023-10-14T11:25:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119892.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116730.log.gz 2023-10-14T11:25:36.078 INFO:teuthology.orchestra.run.smithi067.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119892.log.gz 2023-10-14T11:25:36.079 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117872.log 2023-10-14T11:25:36.079 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120317.log 2023-10-14T11:25:36.079 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119616.log 2023-10-14T11:25:36.080 INFO:teuthology.orchestra.run.smithi067.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117872.log.gz 2023-10-14T11:25:36.080 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120317.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120317.log.gz 2023-10-14T11:25:36.080 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117964.log 2023-10-14T11:25:36.080 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117503.log 2023-10-14T11:25:36.081 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119616.log.gz/var/log/ceph/ceph-client.admin.117964.log: 2023-10-14T11:25:36.081 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117503.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117964.log.gz 2023-10-14T11:25:36.081 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.117503.log.gz 2023-10-14T11:25:36.081 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116638.log 2023-10-14T11:25:36.082 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117642.log 2023-10-14T11:25:36.082 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116125.log 2023-10-14T11:25:36.082 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117642.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116638.log.gz 2023-10-14T11:25:36.083 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116125.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117642.log.gz 2023-10-14T11:25:36.083 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116125.log.gz 2023-10-14T11:25:36.083 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119135.log 2023-10-14T11:25:36.083 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112755.log 2023-10-14T11:25:36.084 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111896.log 2023-10-14T11:25:36.084 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112755.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.119135.log.gz 2023-10-14T11:25:36.084 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111896.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112755.log.gz 2023-10-14T11:25:36.084 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111896.log.gz 2023-10-14T11:25:36.085 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119089.log 2023-10-14T11:25:36.085 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110656.log 2023-10-14T11:25:36.085 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103921.log 2023-10-14T11:25:36.086 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110656.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119089.log.gz 2023-10-14T11:25:36.086 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.103921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110656.log.gz 2023-10-14T11:25:36.086 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103921.log.gz 2023-10-14T11:25:36.086 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117595.log 2023-10-14T11:25:36.087 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119570.log 2023-10-14T11:25:36.087 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117595.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117595.log.gz 2023-10-14T11:25:36.087 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119570.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119570.log.gz 2023-10-14T11:25:36.087 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116079.log 2023-10-14T11:25:36.088 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117734.log 2023-10-14T11:25:36.088 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117052.log 2023-10-14T11:25:36.088 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117734.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116079.log.gz 2023-10-14T11:25:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117052.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117734.log.gz 2023-10-14T11:25:36.089 INFO:teuthology.orchestra.run.smithi067.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117052.log.gz 2023-10-14T11:25:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112333.log 2023-10-14T11:25:36.089 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115337.log 2023-10-14T11:25:36.090 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116412.log 2023-10-14T11:25:36.090 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115337.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112333.log.gz 2023-10-14T11:25:36.090 INFO:teuthology.orchestra.run.smithi067.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115337.log.gz 2023-10-14T11:25:36.090 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116412.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116412.log.gz 2023-10-14T11:25:36.091 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114646.log 2023-10-14T11:25:36.091 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111292.log 2023-10-14T11:25:36.091 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114646.log: /var/log/ceph/ceph-client.admin.111292.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114646.log.gz 2023-10-14T11:25:36.091 INFO:teuthology.orchestra.run.smithi067.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111292.log.gz 2023-10-14T11:25:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111289.log 2023-10-14T11:25:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111658.log 2023-10-14T11:25:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114969.log 2023-10-14T11:25:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111658.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111289.log.gz 2023-10-14T11:25:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114969.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111658.log.gz 2023-10-14T11:25:36.093 INFO:teuthology.orchestra.run.smithi067.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114969.log.gz 2023-10-14T11:25:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111895.log 2023-10-14T11:25:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T11:25:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117236.log 2023-10-14T11:25:36.094 INFO:teuthology.orchestra.run.smithi067.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111895.log.gz 2023-10-14T11:25:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115786.log 2023-10-14T11:25:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117236.log: /var/log/ceph/ceph-client.admin.115786.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117236.log.gz 2023-10-14T11:25:36.095 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115786.log.gz 2023-10-14T11:25:36.095 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117688.log 2023-10-14T11:25:36.096 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111298.log 2023-10-14T11:25:36.096 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117688.log: /var/log/ceph/ceph-client.admin.111298.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117688.log.gz 2023-10-14T11:25:36.096 INFO:teuthology.orchestra.run.smithi067.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111298.log.gz 2023-10-14T11:25:36.096 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104230.log 2023-10-14T11:25:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114738.log 2023-10-14T11:25:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.104230.log: /var/log/ceph/ceph-client.admin.114738.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104230.log.gz 2023-10-14T11:25:36.097 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114738.log.gz 2023-10-14T11:25:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111657.log 2023-10-14T11:25:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118438.log 2023-10-14T11:25:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111657.log: /var/log/ceph/ceph-client.admin.118438.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111657.log.gz 2023-10-14T11:25:36.098 INFO:teuthology.orchestra.run.smithi067.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118438.log.gz 2023-10-14T11:25:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116684.log 2023-10-14T11:25:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112379.log 2023-10-14T11:25:36.101 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-client.3.111245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.111245.log.gz 2023-10-14T11:25:36.102 INFO:teuthology.orchestra.run.smithi072.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T11:25:36.102 INFO:teuthology.orchestra.run.smithi072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T11:25:36.102 INFO:teuthology.orchestra.run.smithi072.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T11:25:36.102 INFO:teuthology.orchestra.run.smithi072.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T11:25:36.103 INFO:teuthology.orchestra.run.smithi072.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T11:25:36.103 INFO:teuthology.orchestra.run.smithi072.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T11:25:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116684.log: /var/log/ceph/ceph-client.admin.112379.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116684.log.gz 2023-10-14T11:25:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T11:25:36.105 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.112379.log.gz 2023-10-14T11:25:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118530.log 2023-10-14T11:25:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.118530.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118530.log.gz 2023-10-14T11:25:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115199.log 2023-10-14T11:25:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115199.log.gz 2023-10-14T11:25:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118576.log 2023-10-14T11:25:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118576.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.118576.log.gz 2023-10-14T11:25:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110110.log 2023-10-14T11:25:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110110.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110110.log.gz 2023-10-14T11:25:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115832.log 2023-10-14T11:25:36.108 INFO:teuthology.orchestra.run.smithi067.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T11:25:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120152.log 2023-10-14T11:25:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115832.log: 88.7%/var/log/ceph/ceph-client.admin.120152.log: -- replaced with /var/log/ceph/ceph-client.admin.115832.log.gz 2023-10-14T11:25:36.109 INFO:teuthology.orchestra.run.smithi067.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120152.log.gz 2023-10-14T11:25:36.109 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T11:25:36.110 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T11:25:36.110 INFO:teuthology.orchestra.run.smithi067.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T11:25:36.110 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T11:25:36.120 INFO:teuthology.orchestra.run.smithi072.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T11:25:36.122 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-10-14T11:25:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m0.198s 2023-10-14T11:25:36.123 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m0.876s 2023-10-14T11:25:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m0.057s 2023-10-14T11:25:36.172 INFO:teuthology.orchestra.run.smithi067.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T11:25:36.174 INFO:teuthology.orchestra.run.smithi067.stderr: 2023-10-14T11:25:36.174 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m0.277s 2023-10-14T11:25:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m0.791s 2023-10-14T11:25:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m0.126s 2023-10-14T11:25:36.176 INFO:tasks.ceph:Archiving logs... 2023-10-14T11:25:36.176 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi067/log 2023-10-14T11:25:36.177 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T11:25:36.513 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi072/log 2023-10-14T11:25:36.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T11:25:36.677 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T11:25:36.701 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T11:25:36.701 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T11:25:36.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T11:25:36.782 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T11:25:36.791 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T11:25:36.792 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:25:36.795 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T11:25:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2023-10-14T11:25:36.812 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-10-14T11:25:36.813 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T11:25:36.813 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2023-10-14T11:25:36.814 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 +4371us[+4371us] +/- 101ms 2023-10-14T11:25:36.814 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -1485us[-1661us] +/- 49ms 2023-10-14T11:25:36.814 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -1157us[-1333us] +/- 84ms 2023-10-14T11:25:36.815 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:25:36.817 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T11:25:36.817 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-10-14T11:25:36.818 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +4380us[+4196us] +/- 101ms 2023-10-14T11:25:36.818 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 20 -1498us[-1681us] +/- 49ms 2023-10-14T11:25:36.818 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -1160us[-1160us] +/- 84ms 2023-10-14T11:25:36.819 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T11:25:36.819 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T11:25:36.829 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T11:25:36.830 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T11:25:36.865 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T11:25:36.966 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-14T11:25:37.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T11:25:37.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:25:37.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T11:25:37.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:25:37.125 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T11:25:37.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T11:25:37.164 INFO:teuthology.task.internal:Duration was 903.579991 seconds 2023-10-14T11:25:37.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T11:25:37.215 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T11:25:37.215 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T11:25:37.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T11:25:37.263 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T11:25:37.264 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T11:25:37.741 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T11:25:37.742 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2023-10-14T11:25:37.742 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T11:25:37.765 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-10-14T11:25:37.765 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T11:25:37.788 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T11:25:37.789 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T11:25:37.807 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T11:25:37.872 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T11:25:37.873 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T11:25:37.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T11:25:37.988 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T11:25:37.999 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T11:25:38.000 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T11:25:38.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T11:25:38.054 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T11:25:38.109 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:25:38.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:25:38.138 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2023-10-14T11:25:38.143 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-10-14T11:25:38.156 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:25:38.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:25:38.210 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T11:25:38.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:25:38.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T11:25:38.238 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T11:25:38.239 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi067 2023-10-14T11:25:38.239 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T11:25:38.290 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261/remote/smithi072 2023-10-14T11:25:38.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T11:25:38.331 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T11:25:38.332 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T11:25:38.334 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T11:25:38.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T11:25:38.394 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T11:25:38.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T11:25:38.415 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T11:25:38.416 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T11:25:38.418 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T11:25:38.433 INFO:teuthology.orchestra.run.smithi067.stdout: 262307 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 11:25 /home/ubuntu/cephtest 2023-10-14T11:25:38.433 INFO:teuthology.orchestra.run.smithi067.stdout: 393242 4 d--------- 2 ubuntu ubuntu 4096 Oct 14 11:24 /home/ubuntu/cephtest/mnt.0 2023-10-14T11:25:38.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T11:25:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-10-14T11:25:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T11:25:38.436 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T11:25:38.443 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T11:25:38.506 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T11:25:38.517 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi067 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T11:25:38.517 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T11:25:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 14 11:25 /home/ubuntu/cephtest 2023-10-14T11:25:38.561 DEBUG:teuthology.nuke:shortname: smithi067 2023-10-14T11:25:38.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T11:25:38.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:04:53.115089', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T11:25:38.588 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-14T11:25:38.588 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T11:25:38.610 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 11:04:53.113527', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-14T11:25:38.633 INFO:teuthology.orchestra.console.smithi067:Power off 2023-10-14T11:25:38.634 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:25:38.661 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2023-10-14T11:25:38.662 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:38.679 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-14T11:25:38.680 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T11:25:38.691 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-10-14T11:25:38.705 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-14T11:25:38.705 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:38.732 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T11:25:42.692 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:42.734 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:42.803 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-10-14T11:25:42.846 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T11:25:46.806 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:46.847 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:46.917 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2023-10-14T11:25:46.959 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-14T11:25:50.919 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:50.960 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T11:25:51.032 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2023-10-14T11:25:51.071 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-14T11:25:51.134 INFO:teuthology.orchestra.console.smithi067:Power off completed 2023-10-14T11:25:51.173 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-14T11:25:51.278 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} duration: 903.5799906253815 failure_reason: 'Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=943140a9820c481388fef6513a736b51 status: fail success: false 2023-10-14T11:25:51.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T11:25:51.361 INFO:teuthology.run:FAIL